What score will o1-pro achieve on FrontierMath?
Basic
7
Ṁ558Feb 1
58%
0-4%
28%
5%-9%
6%
10-19%
4%
20-49%
4%
50+%
This market resolves as soon as OpenAI's o1-pro is tested on FrontierMath by a reputable source. Currently, no model achieves even 2%, as noted on page 9 of https://arxiv.org/pdf/2411.04872
I will not bet in this market.
An introduction to FrontierMath can be found here https://epoch.ai/frontiermath
Update 2025-16-01 (PST) (AI summary of creator comment): - Closing Time: Extended until the release of o3.
Resolution Criteria:
If o1-pro is tested on FrontierMath by a reputable source before the release of o3, the market resolves accordingly.
If no benchmark results by the release of o3, the market resolves as N/A.
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Sort by:
Related questions
Related questions
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
What will be the best performance on FrontierMath by December 31st 2025?
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
71% chance
Will a Chinese-made AI beat o3's December score on Frontier Math by the end of 2025?
78% chance
Will o3's score on the Last Exam be above 30%?
26% chance
What will be the best performance on FrontierMath by December 31st 2025? (old buckets)
Will o3 perform as well on the FrontierMath holdout dataset as it does on the main set?
47% chance
By when will AI score >= 80% on FrontierMath
Before what year will Al achieve 85% or higher score on the FrontierMath benchmark?
Will an AI score over 80% on FrontierMath Benchmark in 2025
20% chance