Gpt-5 >=91% on MMLU? | Manifold

Gpt-5 >=91% on MMLU?

41

1kṀ2615

Dec 31

88%

chance

1H

6H

1D

1W

1M

ALL

GPT-5 Speculation

Get

1,000

to start trading!

People are also trading

GPT-5 Pro's 50% time horizon, per METR

Will GPT-5 score higher than 1350 on the Lmsys Arena Leaderboard

GPT-5: 100+ on AMC

GPT-5: >178 LSAT

GPT-5: 120+ on AMC

GPT-5: 140+ on AMC

Will GPT-5 ace exams?

Will Claude 4 achieve over 95% on the MMLU-Pro benchmark by end of 2025?

GPT-5: >175 LSAT

MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?

Sort by:

This tells us that MMLU is too easy. Someone make a Ph.D. version of it

@Sss19971997 it already exists: https://arxiv.org/abs/2311.12022

predictedYES

Market's closing in a month with no sign of Gpt-5. @firstuserhere can you extend?

bunch of mmlu questions

gemini gets 90% on MMLU, so...

@TheBayesian wait what? share the link? i've not yet looked at it

GPT-4 can probably beat 91% with proper prompt engineering.

I have heard someone already did it using a combination of GPT-4 and some other model

People are also trading

GPT-5 Pro's 50% time horizon, per METR

Will GPT-5 score higher than 1350 on the Lmsys Arena Leaderboard

GPT-5: 100+ on AMC

GPT-5: >178 LSAT

GPT-5: 120+ on AMC

GPT-5: 140+ on AMC

Will GPT-5 ace exams?

Will Claude 4 achieve over 95% on the MMLU-Pro benchmark by end of 2025?

GPT-5: >175 LSAT

MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?

Related questions

GPT-5 Pro's 50% time horizon, per METR

Will GPT-5 score higher than 1350 on the Lmsys Arena Leaderboard

GPT-5: 100+ on AMC

GPT-5: >178 LSAT

GPT-5: 120+ on AMC

GPT-5: 140+ on AMC

Will GPT-5 ace exams?

Will Claude 4 achieve over 95% on the MMLU-Pro benchmark by end of 2025?

GPT-5: >175 LSAT

MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?

© Manifold Markets, Inc.•Terms•Privacy