A Chinese AI model will score over 85% on the MMLU before 2024
18
350Ṁ19k
resolved Mar 16
Resolved
NO

AI
Technical AI Timelines
China
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ366
2Ṁ42
3Ṁ8
4Ṁ5
5Ṁ3

People are also trading

Will a Chinese-made AI beat o3's December score on Frontier Math by the end of 2025?
15% chance
Will any AI model score above 95% on GRAB by the end of 2025?
34% chance
Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?
4% chance
Top score on codeforces by an AI model at the end of 2025
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
15% chance
Will an AI score over 80% on FrontierMath Benchmark in 2025
4% chance
Will any AI model achieve > 40% on Frontier Math before 2026?
38% chance
Will a chatbot from a Chinese company top the LMSYS leaderboard in 2025?
12% chance
Google DeepMind announces a model that outperforms humans on the ARC-AGI-2 benchmark before January 15, 2026
5% chance
What year will the first AI exceed 80% on MLE-bench?
Sort by:

Did not happen @NathanpmYoung

@qumeric The resolution date is apparently Dec 31, 2024, so I guess the creator meant "before 2024 ends"

@CDBiddulph maybe creator set resolution date incorrectly instead?

predictedYES

What do you mean by before 2024? like before 2024 jan 1?

How worried should we be about a chinese lab training on the answers, declaring they've solved MMLU, and not releasing the model so people can't tell they cheated?

People are also trading

Will a Chinese-made AI beat o3's December score on Frontier Math by the end of 2025?
15% chance
Will any AI model score above 95% on GRAB by the end of 2025?
34% chance
Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?
4% chance
Top score on codeforces by an AI model at the end of 2025
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
15% chance
Will an AI score over 80% on FrontierMath Benchmark in 2025
4% chance
Will any AI model achieve > 40% on Frontier Math before 2026?
38% chance
Will a chatbot from a Chinese company top the LMSYS leaderboard in 2025?
12% chance
Google DeepMind announces a model that outperforms humans on the ARC-AGI-2 benchmark before January 15, 2026
5% chance
What year will the first AI exceed 80% on MLE-bench?
© Manifold Markets, Inc.•Terms•Privacy