Will any open-source model rank in the top 3 on Chatbot Arena at the end of 2024?

1kṀ4245

resolved Dec 31

Resolved

ALL

I was browing Twitter and I saw a post by Karpathy postively talking about ChatBot Arena which is a platform for ranking LLMs based on human ratings. As expected OpenAI is holding positions 1, 2 and 3. I wonder if any opensource model will take any of these positions at the end of 2024. I will resolve as yes if this is the case ar the end of 2024

OpenAI

Technical AI Timelines

LLMs

Google

Open Source

Chatbot Arena Leaderboard

Get

1,000

to start trading!

🏅 Top traders

#	Name	Total profit
1		Ṁ179
2		Ṁ114
3		Ṁ63
4		Ṁ51
5		Ṁ48

People are also trading

Will OpenAI top the Chatbot Arena Leaderboard on December 31, 2025?

32% chance

Will a company other than OpenAI, xAI, and Google top the Chatbot Arena Leaderboard in 2025?

28% chance

Which companies will achieve a higher ELO rating than OpenAI on ChatBot Arena in 2025? ( >= week)

Will GPT-4-Turbo be ranked in the top 20 on the Chatbot Arena Leaderboard at the end of 2025?

3% chance

Which Companies will top Chatbot Arena Leaderboard in 2025?

Will the best AI model according to the Chatbot Arena Leaderboard be using Mixture-of-Depths, at the end of 2025?

23% chance

Who will ever rank #1 in LMSYS Chatbot Arena Leaderboard in 2025?

Which Companies will top Chatbot Arena Leaderboard in 2027?

Which Companies will top Chatbot Arena Leaderboard in 2028?

Which Companies will top Chatbot Arena Leaderboard in 2026?

4 Comments

27 Holders

48 Trades

Sort by:

Why would u count gpt4 as 3 different models?

If openai release a new variant every month, seems possible that they occupy all top 10 positions

Would u be kind enough to start a new market where duplicate models count as one?

@HanchiSun good observation I already have 5 markets on ChatBot Arena and would hate to spam everyone on here. Check them out here and I will create another one where duplicates are not allowed but I just need to find a good definition of what constitues a duplicate.

https://manifold.markets/dashboard/chatbot-arena-battle-of-the-llms?r=U29saQ