What organization will have the highest ELO score in the LMSYS Org Chatbot Arena Leaderboard at the end of Dec, 2024?

Plus

Ṁ41k

resolved Dec 31

100%99.6%

Alphabet (Google)

0.2%

OpenAI

0.0%

Anthropic

0.0%

Mistral AI

0.0%

Meta (Facebook)

0.0%

xAI

0.1%

Cavendish Labs

0.1%Other

I'm referring to this Chatbot Arena Leaderboard.

I'm planning on resolving based on who has the highest ELO score. This is because ELO scores were all that existed when I created this question.

Previous quarter: /HankyUSA/who-will-own-the-model-at-the-top-o-d32b40f4edc0
Rank # version: /HankyUSA/what-organizations-will-be-ranked-1-a0eq6c0koo

This question is managed and resolved by Manifold.

#Chatbot Arena Leaderboard

#ELO Ratings

Get

1,000

and

3.00

10 Comments

68 Holders

426 Trades

Sort by:

They changed the column name from "ELO Score" to "Arena Score".

View original context

@traders Last chance to sell unwanted shares.

I think perhaps a prediction should be made for style control elo as opposed to just general elo

bought Ṁ100 YES

Gemini is back on top:

bought Ṁ250 YES

The latest Gemini model has jumped to the top of the leaderboard!

Scott Alexander mentioned this question in Mantic Monday 9/16/24 on Astral Codex Ten.

What other dates should I add to the graph?

@HankyUSA To start:

May 13, 2024: OpenAI releases GPT-4o

June 20, 2024: Anthropic releases Claude 3.5 Sonnet

July 23, 2024: Meta releases Llama 3.1 405B

August 13, 2024: xAI releases Grok 2

@HankyUSA September 12: OpenAI releases o1-preview

They changed the column name from "ELO Score" to "Arena Score".

TIL about Chatbot arena 👍

Related questions

Related questions