Will Meta's new AI model Llama 3.1 405B rank #1 on LMSys leaderboards on August 12th?
105
10kṀ280k
resolved Aug 13
Resolved
NO

AI people are very excited for Meta's new Llama 405B model. It is rumored to be coming out on Tuesday July 23rd, and a copy possibly already leaked.
https://deepnewz.com/ai/meta-s-llama-3-405b-set-release-on-july-23-2024-new-feature-3-1-3-days-left


The rumors are that the model will be the first open source model "better than GPT-4."

https://deepnewz.com/ai/meta-s-llama-3-1-405b-model-leaked-on-4chan-ahead-july-23-launch-size-820-gb

Once the model is released, and has 2+ weeks to run on LMSys, where will it rank?

To be specific, we will check the first LMSys overall leaderboard table that's marked as on or after Monday August 12th. We may delay this if the model is released later than expected, but this will be updated in the rules if that is the unlikely case.

As usual with LMSys, we count statistical ties as reported on the leaderboards.

So a YES would result for a tie for first place or sole first place, presumably against the GPT-4o model that currently leads LMSys as of July 22nd.
https://chat.lmsys.org/?leaderboard

Claude 3.5 Sonnet currently ranks second, tied with Gemini...

Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ5,831
2Ṁ3,263
3Ṁ1,907
4Ṁ1,502
5Ṁ1,343
© Manifold Markets, Inc.TermsPrivacy