
What organization will have the top language model on LMSys overall leaderboards December 1st 2024?
63
15kแน64kresolved Dec 3
50%47%
Google / Gemini
50%50%
OpenAI / ChatGPT
0.9%
Anthropic / Claude
0.3%
Meta / Facebook / LLama
0.9%
xAI / Grok / Elon empire
0.6%Other
As of mid August, Google's Gemini leads LMSys pretty comfortably. Although its score has dipped below 1300.
https://chat.lmsys.org/?leaderboard

Note two things.
LMSys has statistical ties. If multiple orgs tie for first... we will split the payouts. although this is quite unlikely
Secondly, note that the update shows as "Last updated: 2024-08-06." even though it's already August 13th. We will go by the update date. So we are looking at the first snapshot on or after 2024-12-01.
Google seems like a substantial favorite. But maybe not, if GPT-5 / Strawberry ships.
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
๐ Top traders
# | Name | Total profit |
---|---|---|
1 | แน2,345 | |
2 | แน485 | |
3 | แน458 | |
4 | แน380 | |
5 | แน370 |
People are also trading
Related questions
Will a chatbot from a Chinese company top the LMSYS leaderboard in 2025?
29% chance
Who will ever rank Top 10 in LMSYS Chatbot Arena Leaderboard in 2025?
Who will ever rank #1 in LMSYS Chatbot Arena Leaderboard in 2025?
Most popular language model from OpenAI competitor by 2026?
20% chance
Will a chatbot from a Chinese company top the LMSYS leaderboard in 2026?
69% chance
DeepSeek will have the best language model in the world by a clear margin as of Feb 1 2026
5% chance
Best available language model from an OpenAI competitor by 2026
73% chance
What organization will top the LLM leaderboards on LMArena at end of 2025? ๐ค๐