Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (for 1 week)
39
204
Ṁ9.2KṀ730
Dec 30
33%
chance
1D
1W
1M
ALL
I was browing Twitter and I saw a post by Karpathy postively talking about ChatBot Arena which is a platform for ranking LLMs based on human ratings. As expected OpenAI is holding positions 1, 2 and 3. I wonder if any opensource model will take any of these positions at any point in 2024 and keep it for a full week
Get Ṁ200 play money
Sort by:
@Soli I assume by your comment on a similar market that here you're resolving based on elo rather than "Rank." Can you clarify?
command r plus is already surpassing gpt4 on some benchmarks: https://txt.cohere.com/command-r-plus-microsoft-azure/
Related questions
Will there be an AI language model that surpasses ChatGPT and other OpenAI models before the end of 2024?
31% chance
Which companies will achieve a higher ELO rating than OpenAI on ChatBot Arena in 2024? ( >= week)
Which companies will outrank or tie with OpenAI on ChatBot Arena in 2024? (>= week)
Will an Open Source Large Language Model Surpass GPT-4 in Elo Rating on Chatbot Arena by December 31, 2024?
94% chance
Which companies will rank in top 10 on Chatbot Arena at the end of 2024?
Will open-source AI win? (through 2028)
43% chance
Which companies will outrank OpenAI on ChatBot Arena in 2024? (>= week)
Will an open source model beat GPT-4 in 2024?
65% chance
Will OpenAI be on the top of the Chatbot Arena's LLM Leaderboard until EOY 2024?
22% chance
What organization will have the highest ELO score in the LMSYS Org Chatbot Arena Leaderboard at the end of June, 2024?