What organization will have the highest ELO score in the LMSYS Org Chatbot Arena Leaderboard at the end of Dec, 2024?
➕
Plus
68
Ṁ20k
Jan 1
70%
OpenAI
15%
Alphabet (Google)
7%
Anthropic
6%
xAI

I'm referring to this Chatbot Arena Leaderboard.

I'm planning on resolving based on who has the highest ELO score. This is because ELO scores were all that existed when I created this question.

Related:

Get
Ṁ1,000
and
S3.00
Sort by:

They changed the column name from "ELO Score" to "Arena Score".

Alphabet (Google)
bought Ṁ250 Alphabet (Google) YES

The latest Gemini model has jumped to the top of the leaderboard!

Scott Alexander mentioned this question in Mantic Monday 9/16/24 on Astral Codex Ten.

What other dates should I add to the graph?

@HankyUSA To start:

May 13, 2024: OpenAI releases GPT-4o

June 20, 2024: Anthropic releases Claude 3.5 Sonnet

July 23, 2024: Meta releases Llama 3.1 405B

August 13, 2024: xAI releases Grok 2

@HankyUSA September 12: OpenAI releases o1-preview

They changed the column name from "ELO Score" to "Arena Score".

TIL about Chatbot arena 👍

© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules