Will a open source pure Mamaba LLM surpass 82 MMLU on MMLU (5-shot) before end of year 2024?
2
15
Ṁ70Ṁ100
2025
26%
chance
1D
1W
1M
ALL
Will any company release a pure Mamaba LLM that scores over 82 points on the standard full MMLU (5-shot) using https://github.com/EleutherAI/lm-evaluation-harness with open source weights?
Get Ṁ600 play money
More related questions
Related questions
Will there be an open source LLM as good as GPT4 by June 2024?
27% chance
There will be an open source LLM approximately as good or better than GPT4 before 2025
74% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
66% chance
Will a Mamba-based LLM of GPT 3.5 quality or greater be open sourced in 2024?
51% chance
Will openAI have the most accurate LLM across most benchmarks by EOY 2024?
39% chance
What will be true of OpenAI's best LLM by EOY 2025?
Will an LLM have a context window of 20M or more in 2024?
75% chance
Will there be an open source LLM as good as GPT4 by the end of 2024?
84% chance
Will Open Source LLM's Beat Out The Vast Majority of Google and/or OpenAI/Microsofts's Moat by end of June 2024?
31% chance
Which open source LLM will be the top performing open source LLM by July 1, 2024?