How will the best AI score on the 2024 Putnam Exam? (Raw score)
7
1kṀ2740
Jan 1
41%
chance

Resolves as a fraction to r/120, where r is the highest raw score achieved by an AI on the 2024 Putnam Exam, as reported by credible AI labs (models/details not necessary). The score must have been achieved and reported before Dec 31. It goes without saying that the model shouldn’t have been trained on the questions themselves.

I will count scores obtained by running the AI for longer than the human test conditions, such as in cases similar to AlphaProof.

Market context
Get
Ṁ1,000
to start trading!
Sort by:

This tweet claims o1 pro got a raw score of at least 80

https://twitter.com/academisfit/status/1868529612554420489

bought Ṁ400 YES

I believe it

I see two estimates on Twitter so far for o1: scores of 40 and 60. Clearly this market is not going to be decision-relevant to anyone in time for the answer to be well-known, despite how surprised the market would have been with such high scores had it been up for longer with larger subsidies. At this point it's a statement about the inefficiency of Manifold. IMO 2025 market trading has a >100K mana subsidy pool for NO, and yet no one is paying attention to how the AIs are doing on the Putnam. No one else thought to write this question...Mind-boggling.

reposted

This is a pretty short-fuse question. Use it to calibrate your expectations of what will happen in AI math in the next year.

© Manifold Markets, Inc.TermsPrivacy