🐕 OpenLLMs: Will Any Open Source LLM on the HuggingFace OpenLLM Leaderboard Significantly Gain in Avg Score by YE 2024?

150Ṁ441

Jan 1

61%

chance

ALL

Previous market on this topic:

https://manifold.markets/PatrickDelaney/open-source-llms-will-any-open-sour

I reserve the right to upgrade the metric used if the one used in the above market is stale. I aim to have things finalized for this market by end of January 2024.

Third Party Validated, Predictive Markets: AI

Get

1,000

to start trading!

People are also trading

What will be true of OpenAI's best LLM by EOY 2025?

What organization will top the LLM leaderboards on LMArena at end of 2025? 🤖📊

EOY 2025: Will open LLMs perform at least as well as 50 Elo below closed-source LLMs on coding?

62% chance

Will OpenAI release another open source LLM before end of 2026?

77% chance

❓ Which AI model will lead the LLM race by the end of 2025?

Will the highest-scoring LLM on Dec 31, 2026 show <10% improvement over 2025's best average benchmark performance?

59% chance

Will an open source LLM (Vicuna, Alpaca, etc.) exceed ChatGPT interest by 2030?

59% chance

Will Anthropic release a (competetive) opensource LLM in the next 3 years?

31% chance

Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?

Sort by:

taking my money out because i feel like these leaderboards are too fake

predictedYES

What was the top A value at the start of the year?

@ashly_webb 76.72 https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

reposted

Does the addition of a new, better open source model count?

@ashly_webb Yes, because the question is, will ANY OpenLLM...so any includes future, doesn't exist yet.

People are also trading

What will be true of OpenAI's best LLM by EOY 2025?

What organization will top the LLM leaderboards on LMArena at end of 2025? 🤖📊

EOY 2025: Will open LLMs perform at least as well as 50 Elo below closed-source LLMs on coding?

62% chance

Will OpenAI release another open source LLM before end of 2026?

77% chance

❓ Which AI model will lead the LLM race by the end of 2025?

Will the highest-scoring LLM on Dec 31, 2026 show <10% improvement over 2025's best average benchmark performance?

59% chance

Will an open source LLM (Vicuna, Alpaca, etc.) exceed ChatGPT interest by 2030?

59% chance

Will Anthropic release a (competetive) opensource LLM in the next 3 years?

31% chance

Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?

50% chance

People are also trading

People are also trading

Related questions