Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (resolves based on ELO rating)
Plus
60
Ṁ22kresolved Dec 31
Resolved
NO1D
1W
1M
ALL
I was browing Twitter and I saw a post by Karpathy postively talking about ChatBot Arena which is a platform for ranking LLMs based on human ratings. As expected OpenAI is holding positions 1, 2 and 3. I wonder if any opensource model will take any of these positions at any point in 2024 and keep it for a full week
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ2,160 | |
| 2 | Ṁ121 | |
| 3 | Ṁ103 | |
| 4 | Ṁ57 | |
| 5 | Ṁ43 |
Sort by:
@Soli I assume by your comment on a similar market that here you're resolving based on elo rather than "Rank." Can you clarify?
command r plus is already surpassing gpt4 on some benchmarks: https://txt.cohere.com/command-r-plus-microsoft-azure/
Related questions
Related questions
Which companies will achieve a higher ELO rating than OpenAI on ChatBot Arena in 2025? ( >= week)
Who will ever rank #1 in LMSYS Chatbot Arena Leaderboard in 2025?
Will OpenAI top the Chatbot Arena Leaderboard on December 31, 2025?
39% chance
Who will ever rank Top 10 in LMSYS Chatbot Arena Leaderboard in 2025?
Will there be a model with a 69%+ Chatbot Arena win rate against gpt-o1 before June 1st, 2025?
86% chance
Will GPT-4-Turbo be ranked in the top 20 on the Chatbot Arena Leaderboard at the end of 2025?
12% chance
Will Claude Opus be ranked in the top 20 on the Chatbot Arena Leaderboard two years from today (3/10/24)?
13% chance
Will China have a model in the top 10 on LMSYS Chatbot Arena on March 1, 2025?
98% chance
Until what date will an Google model hold the top position in the Chatbot Arena? (>=week)
What will be the highest ELO on Chatbot Arena on Jan 1, 2025?