What organization will have the highest ELO score in the LMSYS Org Chatbot Arena Leaderboard at the end of Dec, 2024?
79
1.5kṀ41k
resolved Dec 31
100%99.6%
Alphabet (Google)
0.2%
OpenAI
0.0%
Anthropic
0.0%
Mistral AI
0.0%
Meta (Facebook)
0.0%
xAI
0.1%
Cavendish Labs
0.1%Other

I'm referring to this Chatbot Arena Leaderboard.

I'm planning on resolving based on who has the highest ELO score. This is because ELO scores were all that existed when I created this question.

Related:

AI
Technology
OpenAI
LLMs
Google
Chatbot Arena Leaderboard
ELO Ratings
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ6,615
2Ṁ1,718
3Ṁ475
4Ṁ365
5Ṁ191

People are also trading

What will be the highest ELO on Chatbot Arena on Jan 1, 2025?
Will a chatbot from a Chinese company top the LMSYS leaderboard in 2025?
35% chance
Which companies will achieve a higher ELO rating than OpenAI on ChatBot Arena in 2025? ( >= week)
Will OpenAI top the Chatbot Arena Leaderboard on December 31, 2025?
32% chance
Which LLM will have the highest ELO at the end of 2025 on ChatBot Arena?
Will a chatbot from a Chinese company top the LMSYS leaderboard in 2026?
69% chance
Will the LMSYS Chatbot Arena still be 'a thing' in 2027, under the same evaluation method?
36% chance
Which Companies will top Chatbot Arena Leaderboard in 2027?
Which Companies will top Chatbot Arena Leaderboard in 2026?
Which Companies will top Chatbot Arena Leaderboard in 2028?
Sort by:

They changed the column name from "ELO Score" to "Arena Score".

View original context

@traders Last chance to sell unwanted shares.

I think perhaps a prediction should be made for style control elo as opposed to just general elo

bought Ṁ100 YES

Gemini is back on top:

bought Ṁ250 YES

The latest Gemini model has jumped to the top of the leaderboard!

Scott Alexander mentioned this question in Mantic Monday 9/16/24 on Astral Codex Ten.

What other dates should I add to the graph?

@HankyUSA To start:

May 13, 2024: OpenAI releases GPT-4o

June 20, 2024: Anthropic releases Claude 3.5 Sonnet

July 23, 2024: Meta releases Llama 3.1 405B

August 13, 2024: xAI releases Grok 2

@HankyUSA September 12: OpenAI releases o1-preview

They changed the column name from "ELO Score" to "Arena Score".

TIL about Chatbot arena 👍

People are also trading

What will be the highest ELO on Chatbot Arena on Jan 1, 2025?
Will a chatbot from a Chinese company top the LMSYS leaderboard in 2025?
35% chance
Which companies will achieve a higher ELO rating than OpenAI on ChatBot Arena in 2025? ( >= week)
Will OpenAI top the Chatbot Arena Leaderboard on December 31, 2025?
32% chance
Which LLM will have the highest ELO at the end of 2025 on ChatBot Arena?
Will a chatbot from a Chinese company top the LMSYS leaderboard in 2026?
69% chance
Will the LMSYS Chatbot Arena still be 'a thing' in 2027, under the same evaluation method?
36% chance
Which Companies will top Chatbot Arena Leaderboard in 2027?
Which Companies will top Chatbot Arena Leaderboard in 2026?
Which Companies will top Chatbot Arena Leaderboard in 2028?
© Manifold Markets, Inc.•Terms•Privacy