Which company will have the best LLM by the end of 2024?
66
1.4kแน€7378
resolved Jun 5
100%80%
Google
19%
OpenAI
0.1%
Meta
0.2%
X.ai
0.4%
Anthropic
0.1%
Mistral
0.1%
Alibaba

Get
แน€1,000
to start trading!

๐Ÿ… Top traders

#NameTotal profit
1แน€424
2แน€393
3แน€382
4แน€271
5แน€193
Sort by:

Dunno how to see past versions of the leaderboard, but this market had the same criteria and resolved to google: https://manifold.markets/Soli/who-will-have-the-best-llm-by-end-o

@mods inactive creator but an easy resolve hopefully

Creator (@AbhinavSrinivas) seems to be inactive. I'm wondering what should happen if multiple companies share rank 1, since that is now possible on LMArena. My reading is that the company with the highest arena score (Elo) should win, just like this question. Do others read it this way as well?

@yetforever yes that seems most reasonable

sold แน€12 YES

How will this market resolve if Meta trains the best LLM, open sources it, and then Mistral finetunes it for a small to moderate amount of additional tokens which makes it perform somewhat better than the original Meta model at the end of 2024?

(As seems to be what's going on with mistral-medium.)

@RyanGreenblatt I think Iโ€™ll run a poll to see what people want. Or maybe Iโ€™ll resolve both as yes.

Related:

Best in what regard?

@mattyb Good question. Iโ€™m mostly thinking using this leaderboard: https://chat.lmsys.org/ (go to the leaderboard tab). If you have any other suggestions then let me know.

@AbhinavSrinivas Ok, by the Arena Elo leaderboard. Thanks

ยฉ Manifold Markets, Inc.โ€ขTermsโ€ขPrivacy