Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (resolves based on ELO rating)
60
1kṀ22kresolved Dec 31
Resolved
NO1D
1W
1M
ALL
I was browing Twitter and I saw a post by Karpathy postively talking about ChatBot Arena which is a platform for ranking LLMs based on human ratings. As expected OpenAI is holding positions 1, 2 and 3. I wonder if any opensource model will take any of these positions at any point in 2024 and keep it for a full week
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ2,160 | |
| 2 | Ṁ121 | |
| 3 | Ṁ103 | |
| 4 | Ṁ57 | |
| 5 | Ṁ43 |
Sort by:
@Soli I assume by your comment on a similar market that here you're resolving based on elo rather than "Rank." Can you clarify?
command r plus is already surpassing gpt4 on some benchmarks: https://txt.cohere.com/command-r-plus-microsoft-azure/
Related questions
Related questions
Will a company other than OpenAI, xAI, and Google top the Chatbot Arena Leaderboard in 2025?
75% chance
Which companies will achieve a higher ELO rating than OpenAI on ChatBot Arena in 2025? ( >= week)
Will OpenAI top the Chatbot Arena Leaderboard on December 31, 2025?
39% chance
Until what date will an Google model hold the top position in the Chatbot Arena? (>=week)
Who will ever rank #1 in LMSYS Chatbot Arena Leaderboard in 2025?
Will GPT-4-Turbo be ranked in the top 20 on the Chatbot Arena Leaderboard at the end of 2025?
10% chance
Who will ever rank Top 10 in LMSYS Chatbot Arena Leaderboard in 2025?
What will be the highest ELO on Chatbot Arena on Jan 1, 2025?
Which Companies will top Chatbot Arena Leaderboard in 2027?
Which Companies will top Chatbot Arena Leaderboard in 2028?