What organization will be at the top of the LMSYS Org Chatbot Arena Leaderboard at the end of March, 2024?
37
611
1.4K
Apr 1
58%
OpenAI
22%
Anthropic
13%
Alphabet (Google)
5%
Mistral AI
1%
Meta (Facebook)
Get Ṁ1,000 play money
Sort by:

Would a “Bing Chat” model powered by an OAI model but with addition features (internet) or fine tuning still count as OAI?

@WillSorenson I might count that as partially Open AI and partially Microsoft but leaning towards Open AI. How likely do you think that is to be the model at the top of the leaderboard?

@HankyUSA Since Google has done it and it scores quite well, pretty good chance! Vanilla pro scores worse than gpt3.5 but pro with bard out scores better than 2 of the 3 gpt4s

bought Ṁ50 of Alphabet (Google) YES

Looks like the "Bard" version of Gemini is doing a lot better in the arena?

Seems like Gemini kinda sucks on chatbot arena. Pro is supposed to be significantly better than GPT-3.5 from Google's internal benchmarks, but it's actually a little bit worse than GPT-3.5 on chatbot arena. I wouldn't expect Ultra to top the chart.

Mistral AI
Mistral AI

Who is Mistral? What models do they own?

Edit: I just couldn't find Mistral AI on Wikipedia. They developed the Mistral 7B and Mixtral 8x7B models.

More related questions