Will Gemini achieve a score above 90% on the MMLU benchmark?
21
410Ṁ2517resolved Dec 6
Resolved
YES1H
6H
1D
1W
1M
ALL
Considering the performance improvement resulting from progress of prompt engineering, I will have a deadline of 2025/1/1.
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ126 | |
| 2 | Ṁ78 | |
| 3 | Ṁ31 | |
| 4 | Ṁ21 | |
| 5 | Ṁ14 |
People are also trading
Gpt-5 >=95% on MMLU?
52% chance
Gpt-5 >=91% on MMLU?
88% chance
Will Gemini outperform GPT-4 at mathematical theorem-proving?
62% chance
Will "Gemini [Ultra, 1.0] smash GPT-4 by 5x"?
18% chance
Will Gemini 1.5 Pro seem to be as good as Gemini 1.0 Ultra for common use cases? [Poll]
70% chance
Will Google Gemini rank above ChatGPT in the App Store at EOY 2026?
26% chance
Sort by:
Added this market here because I thought it could be classified as third party validated. https://manifold.markets/group/third-party-validated-predictive-ma-6bab86c0b8b0/questions
People are also trading
Related questions
Gpt-5 >=95% on MMLU?
52% chance
Gpt-5 >=91% on MMLU?
88% chance
Will Gemini outperform GPT-4 at mathematical theorem-proving?
62% chance
Will "Gemini [Ultra, 1.0] smash GPT-4 by 5x"?
18% chance
Will Gemini 1.5 Pro seem to be as good as Gemini 1.0 Ultra for common use cases? [Poll]
70% chance
Will Google Gemini rank above ChatGPT in the App Store at EOY 2026?
26% chance