What Elo will gpt2-chatbot have on the LMSYS leaderboard?
21
1kṀ1599
resolved May 23
100%97%
1271-1350 (new SOTA)
1.1%
Below 1240 (not SOTA)
1.2%
1241-1270 (match GPT4/Claude 3)
1.0%
1351+ (generation defining - as big a gap as GPT4 v GPT3.5)

Question resolves to its Elo one week after it first appears on the leaderboard.

If [OpenAI / an employee there / whatever org created it] acknowledges this model and gives it a new name (eg, GPT4.5), will resolve to that model's Elo.

If no gpt2-chatbot model is listed on the leaderboard by June 30, will resolve N/A.

https://chat.lmsys.org/?leaderboard

Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ153
2Ṁ52
3Ṁ22
4Ṁ17
5Ṁ13
© Manifold Markets, Inc.•Terms•Privacy