Will openAI have the most accurate LLM across most benchmarks by EOY 2024?
21
1kṀ1401Jan 1
37%
chance
1H
6H
1D
1W
1M
ALL
Benchmark Open-LLM or whatever is sota to compare LLMs by EOY in 2024: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000People are also trading
Related questions
Will open-source AI win (through 2025)?
37% chance
Will xAI rank above OpenAI at EOY?
29% chance
What will be true of OpenAI's best LLM by EOY 2025?
Will OpenAI's next major LLM (after GPT-4) surpass 70% accuracy on the GPQA benchmark?
75% chance
Will OpenAI's next major LLM (after GPT-4) surpass 74% accuracy on the GPQA benchmark?
86% chance
OpenAI to release model weights by EOY?
83% chance
Will OpenAI still be considered one of the top players in AI by end of 2025
98% chance
Conditional on OpenAI releasing an open-source LLM in 2025, will it exceed o3-mini in AIME 2025 score?
65% chance
Will OpenAI's next major LLM (after GPT-4) achieve over 50% resolution rate on the SWE-bench benchmark?
65% chance
Will OpenAI models achieve ≥90% on SimpleBench by the end of 2025?
37% chance