🐕 OpenLLMs: Will Any Open Source LLM on the HuggingFace OpenLLM Leaderboard Significantly Gain in Avg Score by YE 2024? | Manifold

🐕 OpenLLMs: Will Any Open Source LLM on the HuggingFace OpenLLM Leaderboard Significantly Gain in Avg Score by YE 2024?

9

150Ṁ441

Jan 1

61%

chance

1D

1W

1M

ALL

Previous market on this topic:

https://manifold.markets/PatrickDelaney/open-source-llms-will-any-open-sour

I reserve the right to upgrade the metric used if the one used in the above market is stale. I aim to have things finalized for this market by end of January 2024.

Third Party Validated, Predictive Markets: AI

Get

1,000

to start trading!

Sort by:

taking my money out because i feel like these leaderboards are too fake

predictedYES

What was the top A value at the start of the year?

@ashly_webb 76.72 https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

reposted

?

Does the addition of a new, better open source model count?

@ashly_webb Yes, because the question is, will ANY OpenLLM...so any includes future, doesn't exist yet.

Related questions

Will OpenAI reveal a textless LLM before 2025?

Will an open-source LLM under 10B parameters surpass Claude 3.5 Haiku by EOY 2025?

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

Will OpenAI have the best LLM in 2024?

Will an open source LLM (Vicuna, Alpaca, etc.) exceed ChatGPT interest by 2030?

What will be true of OpenAI's best LLM by EOY 2025?

What organization will top the LLM leaderboards on LMArena at end of 2025? 🤖📊

EOY 2025: Will open LLMs match closed-source LLMs on coding to within 50 ELO points?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will there exist an LLM which can beat the latest version of AlphaZero by EOY 2024?

Related questions

Will OpenAI reveal a textless LLM before 2025?

What will be true of OpenAI's best LLM by EOY 2025?

Will an open-source LLM under 10B parameters surpass Claude 3.5 Haiku by EOY 2025?

What organization will top the LLM leaderboards on LMArena at end of 2025? 🤖📊

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

EOY 2025: Will open LLMs match closed-source LLMs on coding to within 50 ELO points?

Will OpenAI have the best LLM in 2024?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will an open source LLM (Vicuna, Alpaca, etc.) exceed ChatGPT interest by 2030?

Will there exist an LLM which can beat the latest version of AlphaZero by EOY 2024?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules