๐ OpenLLMs: Will Any Open Source LLM on the HuggingFace OpenLLM Leaderboard Significantly Gain in Avg Score by YE 2024?
9
150แน441Jan 1
61%
chance
1H
6H
1D
1W
1M
ALL
Previous market on this topic:
https://manifold.markets/PatrickDelaney/open-source-llms-will-any-open-sour
I reserve the right to upgrade the metric used if the one used in the above market is stale. I aim to have things finalized for this market by end of January 2024.
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000People are also trading
What will be true of OpenAI's best LLM by EOY 2025?
What organization will top the LLM leaderboards on LMArena at end of 2025? ๐ค๐
EOY 2025: Will open LLMs perform at least as well as 50 Elo below closed-source LLMs on coding?
30% chance
Conditional on OpenAI releasing an open-source LLM in 2025, will it exceed o3-mini in AIME 2025 score?
65% chance
Will an open source LLM (Vicuna, Alpaca, etc.) exceed ChatGPT interest by 2030?
59% chance
Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?
50% chance
Will LLMs' loss function achieve the level of entropy of human text by the end of 2030?
61% chance
Sort by:
@ashly_webb Yes, because the question is, will ANY OpenLLM...so any includes future, doesn't exist yet.
People are also trading
Related questions
What will be true of OpenAI's best LLM by EOY 2025?
What organization will top the LLM leaderboards on LMArena at end of 2025? ๐ค๐
EOY 2025: Will open LLMs perform at least as well as 50 Elo below closed-source LLMs on coding?
30% chance
Conditional on OpenAI releasing an open-source LLM in 2025, will it exceed o3-mini in AIME 2025 score?
65% chance
Will an open source LLM (Vicuna, Alpaca, etc.) exceed ChatGPT interest by 2030?
59% chance
Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?
50% chance
Will LLMs' loss function achieve the level of entropy of human text by the end of 2030?
61% chance