Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (resolves based on ELO rating)
➕
Plus
57
Ṁ18k
Dec 30
7%
chance

I was browing Twitter and I saw a post by Karpathy postively talking about ChatBot Arena which is a platform for ranking LLMs based on human ratings. As expected OpenAI is holding positions 1, 2 and 3. I wonder if any opensource model will take any of these positions at any point in 2024 and keep it for a full week

Get
Ṁ1,000
and
S3.00
Sort by:

This includes llama-style gated open-weights models presumably? @Soli

yes it does

bought Ṁ30 YES

@Soli I assume by your comment on a similar market that here you're resolving based on elo rather than "Rank." Can you clarify?

@Jacy yes just updated the title

command r plus is already surpassing gpt4 on some benchmarks: https://txt.cohere.com/command-r-plus-microsoft-azure/

© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules