A Chinese AI model will score over 85% on the MMLU before 2024 | Manifold

A Chinese AI model will score over 85% on the MMLU before 2024

Basic

18

Ṁ19k

resolved Mar 16

Resolved

NO

1D

1W

1M

ALL

This question is managed and resolved by Manifold.

#Technical AI Timelines

#🇨🇳 China

Get

1,000

and

3.00

Sort by:

Did not happen @NathanpmYoung

@qumeric The resolution date is apparently Dec 31, 2024, so I guess the creator meant "before 2024 ends"

@CDBiddulph maybe creator set resolution date incorrectly instead?

predictedYES

What do you mean by before 2024? like before 2024 jan 1?

How worried should we be about a chinese lab training on the answers, declaring they've solved MMLU, and not releasing the model so people can't tell they cheated?

Related questions

Will an AI score over 80% on FrontierMath Benchmark in 2025

+7% 1d23% chance

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

What year will the first AI exceed 80% on MLE-bench?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

Will xAI release an LLM with BIG-Bench score as good as GPT-4 Turbo before the end of 2024?

Will a Chinese-made AI beat o3's December score on Frontier Math by the end of 2025?

Will an AI model outperform 95% of Manifold users on accuracy before 2026?

Will China have a model in the top 10 on LMSYS Chatbot Arena on March 1, 2025?

Will a Chinese AI developer announce a model rivaling o3 performance by February 2025?

Will AI image generating models score >= 90% on Winoground by June 1, 2025?

Related questions

Will an AI score over 80% on FrontierMath Benchmark in 2025

Will a Chinese-made AI beat o3's December score on Frontier Math by the end of 2025?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

Will an AI model outperform 95% of Manifold users on accuracy before 2026?

What year will the first AI exceed 80% on MLE-bench?

Will China have a model in the top 10 on LMSYS Chatbot Arena on March 1, 2025?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

Will a Chinese AI developer announce a model rivaling o3 performance by February 2025?

Will xAI release an LLM with BIG-Bench score as good as GPT-4 Turbo before the end of 2024?

Will AI image generating models score >= 90% on Winoground by June 1, 2025?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules