Will a 15 billion parameter LLM match or outperform GPT4 in 2024?
Plus
15
Ṁ835Dec 31
24%
chance
1D
1W
1M
ALL
GPT-4's benchmark results as of its release in march 2023.
Acceptable upto 17 billion.
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Sort by:
@mods can this resolve yes? According to LMSYS, the March 2024 version of GPT-4 is currently ranked 40th and is outclassed by Gemini 1.5 8b in 31st and Gemma 2 9b in 25.
@JonathanMilligan Okay but it isn't a "benchmark" see "GPT-4's benchmark results as of its release in march 2023." Right?
@NathanpmYoung If you look at the original paper where they introduce LLM arena they refer to it as a “benchmark” https://lmsys.org/blog/2023-05-03-arena/ and on the homepage they also refer to it as an eval benchmark. https://lmarena.ai/
Related questions
Related questions
Will xAI develop a more capable LLM than GPT-5 by 2026
59% chance
Will there be an open source LLM as good as GPT4 by the end of 2024?
68% chance
Will there be an open source LLM as good as GPT4 by June 2024?
18% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
82% chance
Will xAI release an LLM with BIG-Bench score as good as GPT-4 Turbo before the end of 2024?
76% chance
Will there be a OpenAI LLM known as GPT-4.5? by 2033
35% chance
Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?
15% chance
Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?
15% chance
Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?
53% chance
an LLM as capable as GPT-4 runs on one 3090 by March 2025
30% chance