Will a text model achieve 100% performance on the MMLU in five years? | Manifold

Will a text model achieve 100% performance on the MMLU in five years?

3

90Ṁ40

2028

28%

chance

1H

6H

1D

1W

1M

ALL

This video predicts that a model will achieve 100% performance on the Massive Multitask Language Understanding Benchmark.

This will resolve YES if a model is listed as having achieved 100 percent performance on the MMLU on papers with code, in a technical document, or published article by 3:00 PM EST June 28, 2028. This will resolve NO if a model is not listed as ahving achieved 100 percent performance on the MMLU.

Market context

Get

1,000

to start trading!

People are also trading

MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?

Benchmark Gap #5: Once a single AI model solves >= 95% of miniF2F, MATH, and MMLU STEM, will it be less than two years before AI models are used as entry-level data science / data analysis / statistics workers?

Will a team consisting primarily of ML models complete MIT Mystery Hunt by 2030?

MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?

Will LLMs' loss function achieve the level of entropy of human text by the end of 2030?

What year will the first AI exceed 80% on MLE-bench?

By 2027, will it be generally agreed upon that LLM produced text > human text for training LLMs?

Related questions

MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?

Benchmark Gap #5: Once a single AI model solves >= 95% of miniF2F, MATH, and MMLU STEM, will it be less than two years before AI models are used as entry-level data science / data analysis / statistics workers?

Will a team consisting primarily of ML models complete MIT Mystery Hunt by 2030?

MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?

Will LLMs' loss function achieve the level of entropy of human text by the end of 2030?

What year will the first AI exceed 80% on MLE-bench?

By 2027, will it be generally agreed upon that LLM produced text > human text for training LLMs?

© Manifold Markets, Inc.•Terms•Privacy