Will OpenAI's next-gen math-focused model score at least 95% on the MATH benchmark?
Plus
27
Ṁ1802resolved Sep 16
Resolved
NO1D
1W
1M
ALL
Resolve to YES if OpenAI's next generation math-focused model achieves a score of 95% or higher on the MATH benchmark.
If the next generation of general models (e.g. GPT-4), code models (e.g. Codex), or any other models specialized for reasoning are released earlier than the math models and score 95% or higher, it will resolve this question to YES.
Benchmarking on a subset of MATH is acceptable.
Using tools(e.g. calculator) & code is allowed.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
Why is this resolving yes? I would have thought no? https://github.com/openai/simple-evals?tab=readme-ov-file#benchmark-results
Related questions
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
71% chance
Will an AI achieve >30% performance on the FrontierMath benchmark before 2026?
78% chance
Will any AI model achieve > 40% on Frontier Math before 2026?
75% chance
Will OpenAI models achieve ≥90% on SimpleBench by the end of 2025?
46% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
64% chance
Will OpenAI o1 (or any direct iteration like o3) get gold on any International Math Olympiad by the end of 2025?
74% chance
Will an AI score over 80% on FrontierMath Benchmark in 2025
19% chance
Will OpenAI's next major LLM (after GPT-4) surpass 70% accuracy on the GPQA benchmark?
66% chance
Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?
16% chance
Will OpenAI's next major LLM (after GPT-4) solve more than 2 of the first 5 new Project Euler problems?
45% chance