Will Gemini achieve a score above 90% on the MATH benchmark? | Manifold

Will Gemini achieve a score above 90% on the MATH benchmark?

AI Google Gemini

Basic

20

Ṁ4.9k

Jan 1

92%

chance

1D

1W

1M

ALL

The current SOTA is 84.3% from GPT-4 Code Interpreter. Code & tool use is allowed.

Get Ṁ1,000 play money

Sort by:

Since this market has no restrictions on public availability or zero shot, I think this should probably already resolve as yes per Gemini 1.5 report

This is a separate MATH than the one that Google reported the benchmark on. And I don't see it beating GPT4 by so much, given most of the other scores were very close.

limit order for yes 10

Related questions

Will Gemini achieve a higher score on the SAT compared to GPT-4?

Will Gemini-1.5-Pro-Exp-0801 Score Above 1165 in Scale AI's Math Evaluation

Will Gemini-1.5-Pro-Exp-0801 Score Above 1165 in Scale AI's Coding Evaluation

Will OpenAI's next-gen math-focused model score at least 95% on the MATH benchmark?

Will Gemini Ultra be on the chatbot arena leaderboard before the end of 2024?

Will Gemini exceed the performance of GPT-4 on the 2022 AMC 10 and AMC 12 exams?

Will Gemini outperform GPT-4 at mathematical theorem-proving?

Will Gemini-1.5-Pro-Exp-0801 Score Above 90.35 (current #1) in Scale AI's Instruction Following Evaluation

Will Gemini Ultra outperform GPT-4V on visual reasoning by the end of 2024?

Will "Gemini [Ultra, 1.0] smash GPT-4 by 5x"?

Related questions

Will Gemini achieve a higher score on the SAT compared to GPT-4?

Will Gemini exceed the performance of GPT-4 on the 2022 AMC 10 and AMC 12 exams?

Will Gemini-1.5-Pro-Exp-0801 Score Above 1165 in Scale AI's Math Evaluation

Will Gemini outperform GPT-4 at mathematical theorem-proving?

Will Gemini-1.5-Pro-Exp-0801 Score Above 1165 in Scale AI's Coding Evaluation

Will Gemini-1.5-Pro-Exp-0801 Score Above 90.35 (current #1) in Scale AI's Instruction Following Evaluation

Will OpenAI's next-gen math-focused model score at least 95% on the MATH benchmark?

Will Gemini Ultra outperform GPT-4V on visual reasoning by the end of 2024?

Will Gemini Ultra be on the chatbot arena leaderboard before the end of 2024?

Will "Gemini [Ultra, 1.0] smash GPT-4 by 5x"?