Before February 2025, will a Gemini model exceed Claude 3.5 Sonnet 10/22's Global Average score on Simple Bench?

100Ṁ522

resolved Feb 5

Resolved

ALL

https://simple-bench.com/ Claude 3.5 Sonnet 10/22 achieves 41.4% whereas the best Gemini model scores 27.1%

SimpleBench

Update 2025-22-01 (PST): - Resolution Date: The market will now be resolved on February 1st, 2025 instead of the previously stated date. (AI summary of creator comment)

New Year's Resolutions 2025

Get

1,000

to start trading!

🏅 Top traders

#	Name	Total profit
1		Ṁ116
2		Ṁ46
3		Ṁ27

People are also trading

Gemini 3.0 Pro outperforms GPT-5 on METR 50% time horizon?

69% chance

Will Gemini 3.0 Pro exceed 80% on SWE-Bench verified?

42% chance

Will Gemini 3.0 Pro outperform Gemini 2.5 Pro on the LMArena (Without Style Control)

76% chance

Gemini 3.0 scores 1500+ on Chatbot Arena in 2025?

53% chance

Gemini 3 exceeds expectations?

40% chance

Before 2026, will Gemini 3.0 exceed GPT-5 in Metr estimated time horizon?

56% chance

Gemini 3 scores above 30 in Humanity's Last Exam?

78% chance

Will Gemini 3.0 Pro Achieve Silver Medal Performance on the 2025 IMO?

46% chance

Who will overtake Gemini 2.5 pro when?

Gemini perfect score on IMO 2026?

Sort by:

@JaundicedBaboon Time to resolve? It's already February everywhere.

bought Ṁ50 YES

Can we go ahead and resolve this one?

@rogs Won't resolve it until February 1st

bought Ṁ5 NO

Now I'm looking at my comment above and wondering what I was thinking. Did I think this was a post about OpenAI models vs Claude rather than about Gemini vs Claude? Why did I think it was resolvable already?