Will Gemini achieve a score above 90% on the MMLU benchmark?
21
984
Ṁ2.5KṀ410
resolved Dec 6
Resolved
YES1D
1W
1M
ALL
Considering the performance improvement resulting from progress of prompt engineering, I will have a deadline of 2025/1/1.
Get Ṁ200 play money
Related questions
🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ126 | |
| 2 | Ṁ78 | |
| 3 | Ṁ31 | |
| 4 | Ṁ21 | |
| 5 | Ṁ14 |
Sort by:
Added this market here because I thought it could be classified as third party validated. https://manifold.markets/group/third-party-validated-predictive-ma-6bab86c0b8b0/questions
Related questions
What will be the score of the new Gemini 1.5 Pro in the LMSYS Chatbot Arena at the end of May?
Will GPT-4.5 score at least 100 in an IQ test?
29% chance
Gpt-5 >=95% on MMLU?
43% chance
Will Gemini Ultra beat GPT-4V on the REBUS benchmark?
17% chance
Will OpenAI's next major LLM (after GPT-4) surpass 70% accuracy on the GPQA benchmark?
49% chance
Will Gemini Ultra be on the chatbot arena leaderboard before the end of 2024?
80% chance
Will a text model achieve 100% performance on the MMLU in five years?
28% chance
Will GPT-5 score at least 100 in an IQ test?
69% chance
Will Gemini achieve a score above 90% on the MATH benchmark?
46% chance
Will Google's Gemini beat GPT4 in terms of capabilities on release?
22% chance