Will a Chinese AI developer announce a model rivaling o3 performance by February 2025?
Basic
12
Ṁ430Feb 2
21%
chance
1D
1W
1M
ALL
Market resolves yes if a major Chinese AI developer (e.g., Tencent, DeepSeek, Baidu, 01, Alibaba, ByteDance, others that seem unlikely to totally fraud) announces evaluation results for a model which tie or surpass OpenAI's o3 December 20th results on any one of the following:
SWE-Bench Verified: 71.7%
Codeforces: 2727 Elo
AIME 2024: 96.7%
GPQA Diamond: 87.7%
Frontier Math: 25.2%
ARC-AGI Semi-Private: 87.5%
Aggressive test time scaling is allowed. Pass@1, as this appears to be what OpenAI did (but I'm not totally sure this makes the most sense, or what to do if this is ambiguous). Benchmark contamination is a concern, but this market will resolve based on stated performance, whether or not benchmark contamination is suspected.
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Related questions
Related questions
Will Anthropic release a model that thinks before it responds like o1 from OpenAI by EOY 2024?
7% chance
Which of these companies will release a model that thinks before it responds like O1 from OpenAI by EOY 2024?
Will OpenAI release o2 (or o3) before 2026?
98% chance
Which AI will be the best at the end of 2025?
Will a new lab create a top-performing AI frontier model before 2028?
57% chance
Which AI will be the best at the end of 2024?
Will there be a reasoning model more powerful than o1-preview, and cheaper and >10x faster than o1-mini, by Nov 12 2025?
46% chance
Will we find out in 2024 about breakthrough Chinese AI progress? (subjective resolution)
20% chance
Will a serious competitor to NVIDIA in the AI chip space emerge before EOY 2027?
72% chance
Will a consumer-grade autonomous AI be released by an established tech firm by the end of 2024?
20% chance