Will an open model with comparable results to GPT-4 on MMLU be released by the end of July 2024?
5
26
Ṁ312Ṁ130
Jul 31
75%
chance
1D
1W
1M
ALL
Must be direct prompting score; no chain of thought or reranking. Comparable means greater or equal to the GPT-4 overall MMLU score.
Open model means the weights are publicly available, including through a signup form. Note this is not the same as "open source".
Get Ṁ600 play money
More related questions
Related questions
Will OpenAI open source the weights to one of the GPT family models in 2024?
38% chance
Will GPT-5 be released before July 2024?
8% chance
Will there be an open source LLM as good as GPT4 by June 2024?
27% chance
Who will release a GPT-4o comparable model in 2024?
Will an open source model beat GPT-4 in 2024?
62% chance
There will be an open source LLM approximately as good or better than GPT4 before 2025
74% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
66% chance
Will Mistral AI release a model that is comparable to GPT-4 using LLM benchmarks by July 1, 2024?
64% chance
Will we have an open-source model better than GPT-4-Turbo before 2025?
62% chance
Will Meta release an open source language model that outperforms GPT-4 by the end of 2024
62% chance