🐕 OpenLLMs: Will Any Open Source LLM on the HuggingFace OpenLLM Leaderboard Significantly Gain in Avg Score by YE 2024? | Manifold

🐕 OpenLLMs: Will Any Open Source LLM on the HuggingFace OpenLLM Leaderboard Significantly Gain in Avg Score by YE 2024?

#Third Party Validated, Predictive Markets: AI

9

56

Ṁ402

Ṁ150

2025

49%

chance

1D

1W

1M

ALL

Previous market on this topic:

https://manifold.markets/PatrickDelaney/open-source-llms-will-any-open-sour

I reserve the right to upgrade the metric used if the one used in the above market is stale. I aim to have things finalized for this market by end of January 2024.

Get Ṁ600 play money

Related questions

Will an open-source LLM beat or match GPT-4 by the end of 2024?

There will be an open source LLM approximately as good or better than GPT4 before 2025

Any Gemini LLM will achieve a higher rating than all OpenAI's GPT-4 models on Chatbot Arena Leaderboard by Jan 1st 2025?

Will Europe be competitive in the LLM race compared to OpenAI or Google at the end of 2024?

What will be true of OpenAI's best LLM by EOY 2025?

Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (resolves based on ELO rating)

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

Will there be an open source LLM as good as GPT4 by the end of 2024?

Will an opensource LLM on huggingface beat an average human at the most common LLM benchmarks by July 1, 2024?

Will OpenAI be on the top of the Chatbot Arena's LLM Leaderboard until EOY 2024?

Sort by:

taking my money out because i feel like these leaderboards are too fake

predicts YES

What was the top A value at the start of the year?

@ashly_webb 76.72 https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

repostedbought Ṁ20 of YES

?

Does the addition of a new, better open source model count?

@ashly_webb Yes, because the question is, will ANY OpenLLM...so any includes future, doesn't exist yet.

Related in Third Party Validated, Predictive Markets: AI

Will an AI get gold on any International Math Olympiad by 2025?

Will an AI be able to speedrun any popular video game faster than the human WR by the end of 2024?

See more Third Party Validated, Predictive Markets: AI questions

More related questions

Will an open-source LLM beat or match GPT-4 by the end of 2024?

There will be an open source LLM approximately as good or better than GPT4 before 2025

Any Gemini LLM will achieve a higher rating than all OpenAI's GPT-4 models on Chatbot Arena Leaderboard by Jan 1st 2025?

Will Europe be competitive in the LLM race compared to OpenAI or Google at the end of 2024?

What will be true of OpenAI's best LLM by EOY 2025?

Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (resolves based on ELO rating)

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

Will there be an open source LLM as good as GPT4 by the end of 2024?

Will an opensource LLM on huggingface beat an average human at the most common LLM benchmarks by July 1, 2024?

Will OpenAI be on the top of the Chatbot Arena's LLM Leaderboard until EOY 2024?

Third Party Validated, Predictive Markets: AI questions

Will an AI get gold on any International Math Olympiad by 2025?

Will an AI be able to speedrun any popular video game faster than the human WR by the end of 2024?

Related questions

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (resolves based on ELO rating)

There will be an open source LLM approximately as good or better than GPT4 before 2025

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

Any Gemini LLM will achieve a higher rating than all OpenAI's GPT-4 models on Chatbot Arena Leaderboard by Jan 1st 2025?

Will there be an open source LLM as good as GPT4 by the end of 2024?

Will Europe be competitive in the LLM race compared to OpenAI or Google at the end of 2024?

Will an opensource LLM on huggingface beat an average human at the most common LLM benchmarks by July 1, 2024?

What will be true of OpenAI's best LLM by EOY 2025?

Will OpenAI be on the top of the Chatbot Arena's LLM Leaderboard until EOY 2024?