Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (resolves based on ELO rating)
60
1kแน22kresolved Dec 31
Resolved
NO1H
6H
1D
1W
1M
ALL
I was browing Twitter and I saw a post by Karpathy postively talking about ChatBot Arena which is a platform for ranking LLMs based on human ratings. As expected OpenAI is holding positions 1, 2 and 3. I wonder if any opensource model will take any of these positions at any point in 2024 and keep it for a full week
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000๐ Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | แน2,160 | |
| 2 | แน121 | |
| 3 | แน103 | |
| 4 | แน57 | |
| 5 | แน43 |
People are also trading
Which companies will achieve a higher ELO rating than OpenAI on ChatBot Arena in 2025? ( >= week)
Will a company other than OpenAI, xAI, and Google top the Chatbot Arena Leaderboard in 2025?
59% chance
Will OpenAI top the Chatbot Arena Leaderboard on December 31, 2025?
32% chance
Who will ever rank #1 in LMSYS Chatbot Arena Leaderboard in 2025?
Will GPT-4-Turbo be ranked in the top 20 on the Chatbot Arena Leaderboard at the end of 2025?
3% chance
Who will ever rank Top 10 in LMSYS Chatbot Arena Leaderboard in 2025?
Will Claude Opus be ranked in the top 20 on the Chatbot Arena Leaderboard two years from today (3/10/24)?
10% chance
What will be the highest ELO on Chatbot Arena on Jan 1, 2025?
Which Companies will top Chatbot Arena Leaderboard in 2027?
Which Companies will top Chatbot Arena Leaderboard in 2028?
Sort by:
@Soli I assume by your comment on a similar market that here you're resolving based on elo rather than "Rank." Can you clarify?
command r plus is already surpassing gpt4 on some benchmarks: https://txt.cohere.com/command-r-plus-microsoft-azure/
People are also trading
Related questions
Which companies will achieve a higher ELO rating than OpenAI on ChatBot Arena in 2025? ( >= week)
Will a company other than OpenAI, xAI, and Google top the Chatbot Arena Leaderboard in 2025?
59% chance
Will OpenAI top the Chatbot Arena Leaderboard on December 31, 2025?
32% chance
Who will ever rank #1 in LMSYS Chatbot Arena Leaderboard in 2025?
Will GPT-4-Turbo be ranked in the top 20 on the Chatbot Arena Leaderboard at the end of 2025?
3% chance
Who will ever rank Top 10 in LMSYS Chatbot Arena Leaderboard in 2025?
Will Claude Opus be ranked in the top 20 on the Chatbot Arena Leaderboard two years from today (3/10/24)?
10% chance
What will be the highest ELO on Chatbot Arena on Jan 1, 2025?
Which Companies will top Chatbot Arena Leaderboard in 2027?
Which Companies will top Chatbot Arena Leaderboard in 2028?