What will be the score of the new Gemini 1.5 Pro in the LMSYS Chatbot Arena at the end of May?
Basic
6
Ṁ1741resolved Jun 2
100%98.5%
1251-1275
0.2%
<1200
0.2%
1200-1225
0.3%
1226-1250
0.2%
1276-1300
0.2%
1301-1325
0.2%
1326-1350
0.2%
1376-1700
0.2%
1401-1425
0.2%
>1425
Leaderboard Link
https://chat.lmsys.org/?leaderboard
Gemini 1.5 Pro general announcement link:
https://developers.googleblog.com/2024/04/gemini-15-pro-in-public-preview-with-new-features.html
If the model is not added until the resulution datge this resolve N/A
Related market
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
When will an LLM enter and maintain 1360 ELO on LMSys for 10,000 votes? OpenAI? Gemini? Anthropic?
What organization(s) will be ranked #1 in the LMSYS Org Chatbot Arena Leaderboard at the end of December 2024?
What organization will have the highest ELO score in the LMSYS Org Chatbot Arena Leaderboard at the end of Dec, 2024?
Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?
12% chance
Will Gemini-1.5-Pro-Exp-0801 Score Above 1165 in Scale AI's Math Evaluation
48% chance
Will Gemini Ultra be on the chatbot arena leaderboard before the end of 2024?
14% chance
Who will ever rank #1 in LMSYS Chatbot Arena Leaderboard in 2025?
What will be the highest score of a bot based on an open-source LLM in the Motley Bot Challenge?
50% chance
Who will ever rank Top 10 in LMSYS Chatbot Arena Leaderboard in 2025?
Before February 2025, will a Gemini model exceed Claude 3.5 Sonnet 10/22's Global Average score on LiveBench?
55% chance