an LLM as capable as GPT-4 will run on a 3090 before March 2024
23
430Ṁ4814resolved Mar 12
Resolved
NO1H
6H
1D
1W
1M
ALL
e.g. Winograde >= 87.5%
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ118 | |
| 2 | Ṁ74 | |
| 3 | Ṁ45 | |
| 4 | Ṁ37 | |
| 5 | Ṁ31 |
People are also trading
China will make a LLM approximately as good or better than GPT4 before 2025
89% chance
Size of smallest open-source LLM marching GPT 3.5's performance in 2025? (GB)
1.83
Will xAI develop a more capable LLM than GPT-5 before 2026
68% chance
When will an open-source LLM be released with a better performance than GPT-4?
GPT-4 performance and compute efficiency from a simple architecture before 2026
19% chance
Sort by:
predictedNO
the initial question was specifically about winogrande, but MMLU would also be acceptable. fits on a single 3090. quantization could be allowed if quantized performance is comparable, but that might be annoying to evaluate
Winograde? Do you mean the Winogrande benchmark? Like specifically this one? (Any requirement for the LLM in question to be open?)
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
People are also trading
Related questions
China will make a LLM approximately as good or better than GPT4 before 2025
89% chance
Size of smallest open-source LLM marching GPT 3.5's performance in 2025? (GB)
1.83
Will xAI develop a more capable LLM than GPT-5 before 2026
68% chance
When will an open-source LLM be released with a better performance than GPT-4?
GPT-4 performance and compute efficiency from a simple architecture before 2026
19% chance