Will Claude 3.5 Opus beat OpenAI's best released model on the arena.lmsys.org leaderboard?
50
100Ṁ5482
resolved Aug 1
Resolved as
5%

OpenAI's best released model could be GPT-4, GPT-4o, or something else. It does not count as an OpenAI model unless it's made available to the public to try, and is known to be from OpenAI (e.g. the model can not be a secret, pseudonymous release). If arena.lmsys.org is not available at the time, the successor site or most similar leaderboard will be used.

Resolves yes if Claude 3.5 Opus is ranked above all OpenAI models 1 week after it is put on the leaderboard.

  • Update 2025-01-01 (PST) (AI summary of creator comment): - Models must be listed on lmarena to be counted.

    • Examples:

    • o1 pro does not count since it's not on the arena.

    • Regular o1 does count.

Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ1,066
2Ṁ247
3Ṁ130
4Ṁ96
5Ṁ61
Sort by:

This is resolved to "nearly no" as it's not really fair to the question to resolve NA (Opus 4 did not beat o3), but technically, Opus "3.5" was never released (with that name).

If the model is not on lmarena, then it will not count. For example, o1 pro does not count now since it's not on the arena. Regular o1 does count.

© Manifold Markets, Inc.TermsPrivacy