When will humanity's last exam be saturated? (>80%)
42
1kṀ80602030
9%
2025
45%
2026
24%
2027
5%
2028
3%
2029
2%
2030
11%
later / never
Resolves to the year in which an AI first achieves an accuracy of at least 80%.
Text-only models are allowed. o3-mini (high) is currently in the lead with an accuracy of 13.0%
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000Sort by:
What does this resolve to if it never gets >80%, e.g. if more than 20% of the questions are broken? I'm guessing "later"
Related questions
Related questions
What will be o3's score on Humanity's Last Exam?
Humanity's Last Exam score in 2025?
58.3
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2030?
60% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2028?
40% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2027?
39% chance
Will there be another benchmark/test after "Humanity's Last Exam"?
89% chance
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2027?
76% chance
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2028?
82% chance