Which company will have the best LLM by the end of 2024?
Standard
63
Ṁ4836
Jan 1
67%
OpenAI
16%
X.ai
9%
Google
7%
Anthropic
0.7%
Meta
0.3%
Mistral
0.3%
Alibaba

Get
Ṁ1,000
and
S1.00
Sort by:
sold Ṁ12 Google YES

How will this market resolve if Meta trains the best LLM, open sources it, and then Mistral finetunes it for a small to moderate amount of additional tokens which makes it perform somewhat better than the original Meta model at the end of 2024?

(As seems to be what's going on with mistral-medium.)

@RyanGreenblatt I think I’ll run a poll to see what people want. Or maybe I’ll resolve both as yes.

Related:

Best in what regard?

@mattyb Good question. I’m mostly thinking using this leaderboard: https://chat.lmsys.org/ (go to the leaderboard tab). If you have any other suggestions then let me know.

@AbhinavSrinivas Ok, by the Arena Elo leaderboard. Thanks