By EOY 2025, will the model with the lowest perplexity on Common Crawl will not be based on transformers? | Manifold

By EOY 2025, will the model with the lowest perplexity on Common Crawl will not be based on transformers?

Plus

32

Ṁ3701

2025

27%

chance

1D

1W

1M

ALL

If perplexity on Common Crawl is not available for models, I will use other benchmarks as a surrogate. This will inherently be a judgement process. If a model has not been announced by EOY 2025 and no benchmarks have been posted publicly, it will not be counted for the purpose of this market.

"Based on transformers" for the purpose of this question will be anything with multi-headed self-attention that feeds into an MLP.

This question is managed and resolved by Manifold.

Get

1,000

and

3.00

Sort by:

predicts NO

A MoE of transformer model still counts as "based on transformers" right?

predicts NO

Just to be clear here, if we think that it will be based on transformers, then we should vote No?

predicts NO

@jonsimon correct

@jonsimon wish they didn't not write the title with not so many double negatives

predicts NO

@ConnorMcCormick oh yeah that's definitely confusing people. We'll, better for us who do understand it :)

and thanks for the exit gigacasting! $1 -> $68 in five minutes

predicts NO

there are few situations where you want to buy a new market from 50% to 99.2%, you're just giving free money away, use limit oreders pls

lmao i beat michael's bot in buying shares

predicts NO

giving me a solid +2892.5% profit for m$1

i'mt not entirely sure what NO means on this market though

@jacksonpolack The API only refreshes the data every 15 seconds, so if you're quick on the draw, it's totally doable.

predicts NO

i'mt not entirely sure what NO means on this market though

Lol, me neither.

Related questions

By the end of Q1 2025 will an open source model beat OpenAI’s o1 model?

+42% 1d74% chance

By EOY 2026, will it seem as if deep learning hit a wall by EOY 2025?

When will a non-Transformer model become the top open source LLM?

Will OpenAI release an image model better than DALL-E 3 in 2024?

By the end of Q3 2025 will an open source model beat OpenAI’s o1 model?

+6% 1d77% chance

Will Anthropic, Google, xAI or Meta release a model that thinks before it responds like o1 from OpenAI by EOY 2024?

+7% 1d51% chance

Will Transformer based architectures still be SOTA for language modelling by 2026?

On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

Which of these companies will release a model that thinks before it responds like O1 from OpenAI by EOY 2024?

Related questions

By the end of Q1 2025 will an open source model beat OpenAI’s o1 model?

Will Anthropic, Google, xAI or Meta release a model that thinks before it responds like o1 from OpenAI by EOY 2024?

By EOY 2026, will it seem as if deep learning hit a wall by EOY 2025?

Will Transformer based architectures still be SOTA for language modelling by 2026?

When will a non-Transformer model become the top open source LLM?

On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark

Will OpenAI release an image model better than DALL-E 3 in 2024?

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

By the end of Q3 2025 will an open source model beat OpenAI’s o1 model?

Which of these companies will release a model that thinks before it responds like O1 from OpenAI by EOY 2024?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules