
When will humanity's last exam be saturated? (>80%)
45
Ṁ1kṀ8.8k2030
1.6%
2025
53%
2026
32%
2027
4%
2028
3%
2029
1.5%
2030
5%
later / never
Resolves to the year in which an AI first achieves an accuracy of at least 80%.
Text-only models are allowed. o3-mini (high) is currently in the lead with an accuracy of 13.0%

This question is managed and resolved by Manifold.
Market context
Get
1,000 to start trading!
People are also trading
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
Top score on Humanity's Last Exam > 50% by 2028?
98% chance
Top score on Humanity's Last Exam > 50% by 2029?
99% chance
Top score on Humanity's Last Exam > 50% by 2027?
98% chance
Top score on Humanity's Last Exam > 80% by what year?
Top score on Humanity's Last Exam > 90% by what year?
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2027?
69% chance
Top score on Humanity's Last Exam > 70% by what year?
Top score on Humanity's Last Exam > 60% by what year?
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2030?
33% chance
Sort by:
What does this resolve to if it never gets >80%, e.g. if more than 20% of the questions are broken? I'm guessing "later"
People are also trading
Related questions
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
Top score on Humanity's Last Exam > 50% by 2028?
98% chance
Top score on Humanity's Last Exam > 50% by 2029?
99% chance
Top score on Humanity's Last Exam > 50% by 2027?
98% chance
Top score on Humanity's Last Exam > 80% by what year?
Top score on Humanity's Last Exam > 90% by what year?
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2027?
69% chance
Top score on Humanity's Last Exam > 70% by what year?
Top score on Humanity's Last Exam > 60% by what year?
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2030?
33% chance