What will be true of the first model to cross 1400 on lmarena.ai?
16
1kṀ4694
resolved Mar 1
Resolved
NO
Gemini Exp
Resolved
NO
ChatGPT 4o
Resolved
NO
o1
Resolved
NO
Gemini 2.0
Resolved
NO
Claude 3.5 Opus
Resolved
NO
Claude 4
Resolved
YES
Grok
Resolved
NO
OpenAI model code named Orion
Resolved
NO
GPT 5

Will resolve if a model stays at or above 1400 for a week and has a 95% CI with a lower bound of at least 1395 at the end of that week (somewhat arbitrary criteria to ensure the score is based on a sufficient amount of votes)

Will N/A if they change the scoring significantly so that a current model passes 1400.

Current rankings (11/22/24):

  1. Gemini Exp 1121: 1365

  2. ChatGPT 4o Latest (2024-11-20): 1360

  3. Gemini Exp 1114: 1343

  4. o1 preview: 1334

  5. o1 mini: 1308

  6. Gemini 1.5 Pro-002: 1301

  7. Grok 2 0813: 1289

  8. Yi Lightning: 1287

  9. GPT 4o 2024-05-13: 1285

  10. Claude 3.5 Sonnet (20241022): 1282

  • Update 2025-24-01 (PST): - If a Deepseek model is first to cross 1400, all will resolve to NO (AI summary of creator comment)

Technology
AI
Technical AI Timelines
OpenAI
LLMs
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ128
2Ṁ128
3Ṁ66
4Ṁ66
5Ṁ14
Sort by:

Resolution criteria

"stays at or above 1400 for a week and has a 95% CI with a lower bound of at least 1395 at the end of that week"

early Grok 3 is over 1400 as of 02-16, so will need to maintain that rating until 02-22 to resolve to yes

bought Ṁ50 NO

If a Deepseek model is first to cross 1400, all of these will resolve NO

@ChinmayTheMathGuy also o3

People are also trading

any model on the Chatbot Arena LLM Leaderboard at https://lmarena.ai/ reaches an Arena Score of at least 1520.0 (≥1520)
-3% 1d5% chance
First model series to cross 1500 on lmarena.ai?
Model at 1600 Elo on lmarena before 2026?
3% chance
Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?
3% chance
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
15% chance
Will an AI model achieve superhuman ELO on Codeforces by the 31 December 2025?
35% chance
if openai overtakes google on lmarena in 2025, will google take it back also in 2025?
15% chance
Will a single model achieve superhuman performance on all OpenAI gym environments by 2025?
22% chance
Will a publicly known AI model achieve an 80% time horizon that is an 1 hour and 30 minutes by September 2026?
50% chance
Any LMArena model breaks 1600 Elo by 2027?
39% chance
© Manifold Markets, Inc.•Terms•Privacy