an LLM as capable as GPT-4 will run on a 3090 before March 2024
Basic
23
Ṁ4814resolved Mar 12
Resolved
NO1D
1W
1M
ALL
e.g. Winograde >= 87.5%
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
predicted NO
the initial question was specifically about winogrande, but MMLU would also be acceptable. fits on a single 3090. quantization could be allowed if quantized performance is comparable, but that might be annoying to evaluate
Winograde? Do you mean the Winogrande benchmark? Like specifically this one? (Any requirement for the LLM in question to be open?)
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
Related questions
Related questions
an LLM as capable as GPT-4 runs on one 3090 by March 2025
30% chance
an LLM as capable as GPT-4 runs on one 4090 by March 2025
31% chance
Which next-gen frontier LLMs will be released before GPT-5? (2025)
Will there be an open source LLM as good as GPT4 by the end of 2024?
68% chance
Will there be an open source LLM as good as GPT4 by June 2024?
18% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
81% chance
Will a 15 billion parameter LLM match or outperform GPT4 in 2024?
24% chance
Will there be a OpenAI LLM known as GPT-4.5? by 2033
35% chance
Will xAI develop a more capable LLM than GPT-5 by 2026
59% chance
Will it be possible to run an LLM of GPT-4 (or higher) capability on a portable device by 2027?
47% chance