When will humanity's last exam be saturated? (>80%)
43
1kṀ8331
2030
3%
2025
37%
2026
31%
2027
6%
2028
4%
2029
3%
2030
17%
later / never

Resolves to the year in which an AI first achieves an accuracy of at least 80%.

Text-only models are allowed. o3-mini (high) is currently in the lead with an accuracy of 13.0%

https://lastexam.ai/

Technology
AI
Technical AI Timelines
Math
AI Benchmarks
Get
Ṁ1,000
to start trading!

People are also trading

What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
Will OpenAI's o4 get above 50% on humanity's last exam?
15% chance
Humanity's Last Exam score in 2025?
50.4
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2028?
75% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2030?
60% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2028?
39% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2027?
45% chance
Will there be another benchmark/test after "Humanity's Last Exam"?
90% chance
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2027?
68% chance
Sort by:

Huh, I checked a random question in there out of curiosity and the given answer is just wrong.

Related market: https://manifold.markets/Bayesian/what-will-be-the-best-ai-performanc

What does this resolve to if it never gets >80%, e.g. if more than 20% of the questions are broken? I'm guessing "later"

@Nikola fixed ty

People are also trading

What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
Will OpenAI's o4 get above 50% on humanity's last exam?
15% chance
Humanity's Last Exam score in 2025?
50.4
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2028?
75% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2030?
60% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2028?
39% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2027?
45% chance
Will there be another benchmark/test after "Humanity's Last Exam"?
90% chance
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2027?
68% chance
© Manifold Markets, Inc.•Terms•Privacy