an LLM as capable as GPT-4 will run on a 3090 before March 2024
23
197
Ṁ4.8KṀ430
resolved Mar 12
Resolved
NO1D
1W
1M
ALL
e.g. Winograde >= 87.5%
Get Ṁ200 play money
Related questions
🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ118 | |
| 2 | Ṁ74 | |
| 3 | Ṁ45 | |
| 4 | Ṁ37 | |
| 5 | Ṁ31 |
Sort by:
predicted NO
the initial question was specifically about winogrande, but MMLU would also be acceptable. fits on a single 3090. quantization could be allowed if quantized performance is comparable, but that might be annoying to evaluate
Winograde? Do you mean the Winogrande benchmark? Like specifically this one? (Any requirement for the LLM in question to be open?)
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
Related questions
Related questions
Will a LLM beat human experts on GPQA by Jan 1, 2025?
45% chance
an LLM as capable as GPT-4 runs on one 3090 by March 2025
27% chance
Will there be an open source LLM as good as GPT4 by June 2024?
39% chance
Will there be a OpenAI LLM known as GPT-4.5? by 2033
37% chance
Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?
49% chance
Will there be an open source LLM as good as GPT4 by the end of 2024?
69% chance
Will xAI release an LLM with BIG-Bench score as good as GPT-4 before the end of 2024?
54% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
64% chance
Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?
45% chance
Will there be a gpt-4 quality LLM with distributed inference by the end of 2024?
31% chance