What score will o1-pro achieve on FrontierMath?
Basic
7
Ṁ558
Feb 1
58%
0-4%
28%
5%-9%
6%
10-19%
4%
20-49%
4%
50+%

This market resolves as soon as OpenAI's o1-pro is tested on FrontierMath by a reputable source. Currently, no model achieves even 2%, as noted on page 9 of https://arxiv.org/pdf/2411.04872

I will not bet in this market.

An introduction to FrontierMath can be found here https://epoch.ai/frontiermath

  • Update 2025-16-01 (PST) (AI summary of creator comment): - Closing Time: Extended until the release of o3.

    • Resolution Criteria:

    • If o1-pro is tested on FrontierMath by a reputable source before the release of o3, the market resolves accordingly.

    • If no benchmark results by the release of o3, the market resolves as N/A.

#AI
#OpenAI
#Math
#AI Benchmarks
#Competition Math
Get
Ṁ1,000
and
S3.00
Sort by:

Since there are no FrontierMath results for o1-pro, I've extended the closing time until o3 is presumably released. If there are no benchmark results by then, it's very unlikely there will be any, as OpenAI won't spend resources testing an obsolete model, and this market will resolve as N/A.

Related questions

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules