A Chinese AI model will score over 85% on the MMLU before 2024

AI•Technical AI Timelines•China

18

201

Ṁ19K

Ṁ350

resolved Mar 16

Resolved

NO

1D

1W

1M

ALL

Get Ṁ200 play money

Related questions

Human-machine intelligence parity achieved before 2028

Eliezer Yudkowsky is impressed by a machine learning model, and believes that the model may be very helpful for alignment research, by the end of 2026

Will an AI model outperform 95% of Manifold users on accuracy before 2026?

Will an AI get a perfect SAT score before 2025?

The AI company with the smartest AI system by the end of 2026

Will an AI agent system be able to score at least 40% on level 3 tasks in the GAIA benchmark before 2025.

Will a large language model beat a super grandmaster playing chess by 2028?

Will China be competitive in the LLM race compared to OpenAI, Anthropic, and Google by end of 2024?

Will general purpose AI models beat average score of human players in Diplomacy by 2028?

Human-machine intelligence parity achieved before 2030

🏅 Top traders

#	Name	Total profit
1		Ṁ366
2		Ṁ42
3		Ṁ8
4		Ṁ5
5		Ṁ3

Sort by:

bought Ṁ1,000 of NO

Did not happen @NathanpmYoung

sold Ṁ7 of YES

@qumeric The resolution date is apparently Dec 31, 2024, so I guess the creator meant "before 2024 ends"

bought Ṁ500 of NO

@CDBiddulph maybe creator set resolution date incorrectly instead?

predicted YES

What do you mean by before 2024? like before 2024 jan 1?

How worried should we be about a chinese lab training on the answers, declaring they've solved MMLU, and not releasing the model so people can't tell they cheated?

Related in AI

In early 2028, will an AI be able to generate a full high-quality movie to a prompt?

Will Marques Brownlee (MKBHD) release a review of the Rabbit R1 before the end of April 2024?

-11% 1d68% chance

See more AI questions

Related in Technical AI Timelines

Will an AI get gold on any International Math Olympiad by 2025?

-4% 1d20% chance

Will a large language model beat a super grandmaster playing chess by 2028?

See more Technical AI Timelines questions

Related in China

Which country will build the first Military Space Station?

Will China's GDP surpass US GDP before 2035?

+4% 1d54% chance

See more China questions

More related questions

Human-machine intelligence parity achieved before 2028

Eliezer Yudkowsky is impressed by a machine learning model, and believes that the model may be very helpful for alignment research, by the end of 2026

Will China be competitive in the LLM race compared to OpenAI, Anthropic, and Google by end of 2024?

-16% 1d30% chance

Will general purpose AI models beat average score of human players in Diplomacy by 2028?

Human-machine intelligence parity achieved before 2030

Will an AI agent system be able to score at least 40% on level 3 tasks in the GAIA benchmark before 2025.

Will an AI model outperform 95% of Manifold users on accuracy before 2026?

Will an AI get a perfect SAT score before 2025?

The AI company with the smartest AI system by the end of 2026

AI questions

In early 2028, will an AI be able to generate a full high-quality movie to a prompt?

Will Marques Brownlee (MKBHD) release a review of the Rabbit R1 before the end of April 2024?

Technical AI Timelines questions

Will an AI get gold on any International Math Olympiad by 2025?

Will a large language model beat a super grandmaster playing chess by 2028?

China questions

Which country will build the first Military Space Station?

Will China's GDP surpass US GDP before 2035?

Related questions

Human-machine intelligence parity achieved before 2028

Will an AI agent system be able to score at least 40% on level 3 tasks in the GAIA benchmark before 2025.

Eliezer Yudkowsky is impressed by a machine learning model, and believes that the model may be very helpful for alignment research, by the end of 2026

Will an AI model outperform 95% of Manifold users on accuracy before 2026?

Will China be competitive in the LLM race compared to OpenAI, Anthropic, and Google by end of 2024?

Will an AI get a perfect SAT score before 2025?

Will general purpose AI models beat average score of human players in Diplomacy by 2028?

The AI company with the smartest AI system by the end of 2026

Human-machine intelligence parity achieved before 2030