Will an open source model beat any gpt-4 in eq-bench by the end of February 2024?
32
590Ṁ3200resolved Mar 6
Resolved
YES1D
1W
1M
ALL
I will benchmark it myself.
Here, open source means weights publicly available regardless of license.
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ75 | |
| 2 | Ṁ31 | |
| 3 | Ṁ30 | |
| 4 | Ṁ19 | |
| 5 | Ṁ13 |
Sort by:
ShinojiResearch/Senku-70B-Full scores higher on EQ-Bench than gpt-4-0613 and gpt-4-0125-preview as per eqbench.com
Related questions
Related questions
Will an open source model beat GPT-4 in 2024?
76% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
83% chance
Will we have an open-source model that is equivalent GPT-4 by end of 2025?
82% chance
Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?
13% chance
Will there be an open source LLM as good as GPT4 by June 2024?
12% chance
Will an open-source fully functional Auto-GPT like LLM exist by the end of 2025?
89% chance
Will a single model running on a single consumer GPU (<1.5k 2020 USD) outperform GPT-3 175B on all benchmarks in the original paper by 2025?
86% chance
In what year will a GPT4-equivalent model be able to run on consumer hardware?
2026
In what year will a GPT4-equivalent model be able to run on consumer hardware?
2026
Will an uncensored open-source LLM model comparable to 2023 GPT4 be available to the public by the end of 2025?
84% chance