Will OpenAI's o4 get above 50% on humanity's last exam?
33
1kṀ54832027
53%
chance
1D
1W
1M
ALL
Resolves N/A if there is no o4 model. o4 is defined as any compute setting on the o4 model. Something like deepresearch (which is based on o3/o4) would also resolve yes.
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000Related questions
Related questions
Will any AI get a score of at least 45% on Humanity’s Last Exam benchmark before March 11, 2025?
5% chance
Will there be a score of 80% or higher on Humanity's Last Exam before April 1, 2025?
3% chance
Will there be a significant AI safety incident involving OpenAI o1 before April 2025?
3% chance
What will be o3's score on Humanity's Last Exam?
What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
Humanity's Last Exam score in 2025?
49.3
Will OpenAI's next major LLM (after GPT-4) surpass 70% accuracy on the GPQA benchmark?
66% chance
Will OpenAI's next major LLM (after GPT-4) surpass 74% accuracy on the GPQA benchmark?
85% chance
When will OpenAI announce o4?
Will "OpenAI o1" make the top fifty posts in LessWrong's 2024 Annual Review?
8% chance