Will Reflection Llama 3.1 70B be proven to beat Llama 3.1 405B Instruct in GPQA by the end of September 2024?
Mini
8
Ṁ993Sep 30
2%
chance
1D
1W
1M
ALL
Matt Shumer announced the "world’s top open-source model" on Twitter nearly three days ago and AI Twitter has been going off ever since.
This question specifically uses GPQA as it is the only non-saturated eval in Shumer's original post. Acceptable evidence will be either Hugging Face's Open LLM Leaderboard v2 or other highly credible sources for evaluation data.
Get Ṁ1,000 play money
Related questions
Related questions
Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?
18% chance
Will Meta release a Llama 3 405B multi-modal open source before the end of 2024?
46% chance
Will a LLM beat human experts on GPQA by Jan 1, 2025?
90% chance
Will any foundation model score 75 or higher on The Foundation Model Transparency Index by the end of 2024? (LLama2: 54)
45% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
81% chance
Will Llama 4 be the best LLM in the chatbot arena?
16% chance