Will we have an open-source model better than GPT-4-Turbo before 2025?
Will we have an open-source model better than GPT-4-Turbo before 2025?
40
1kṀ4859
resolved Jan 1
Resolved
YES

Currently, near the end of 2023, the chatbot arena leaderboard is topped by GPT-4-Turbo. The license column of the leaderboard marks this LLM as "proprietary".

This question resolves YES if, at the end of 2024, there is a model on the leaderboard which ranks higher than GPT-4-Turbo, but which is open-source. This means that model weights/other code for the model should be available for public download and possible to run, given a powerful-enough computer.

The Elo rating of the highest ranking open source model will be compared to the Elo rating of GPT-4-Turbo on the close date. If GPT-4-Turbo is no longer listed, then the Elo rating of the highest ranking open source model will be compared to 1217, the current Elo rating of GPT-4-Turbo as of market creation.

AI
OpenAI
LLMs
Chatbot Arena Leaderboard
GPT-4
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ182
2Ṁ173
3Ṁ115
4Ṁ111
5Ṁ81


Sort by:
opened a Ṁ500 YES at 81% order10mo

Resolves YES (at the end of 2024, technically) because, even though people debate whether Llama-3.1 is open source, it clearly meets the definition in this market, "model weights/other code for the model should be available for public download and possible to run, given a powerful-enough computer."

What is this?

What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Or create your own play-money betting market on any question you care about.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like betting still use Manifold to get reliable news.
ṀWhy use play money?
Mana (Ṁ) is the play-money currency used to bet on Manifold. It cannot be converted to cash. All users start with Ṁ1,000 for free.
Play money means it's much easier for anyone anywhere in the world to get started and try out forecasting without any risk. It also means there's more freedom to create and bet on any type of question.

People are also trading

© Manifold Markets, Inc.•Terms•Privacy