This tells us that MMLU is too easy. Someone make a Ph.D. version of it

@Sss19971997 it already exists: https://arxiv.org/abs/2311.12022

Market's closing in a month with no sign of Gpt-5. @firstuserhere can you extend?

bunch of mmlu questions

gemini gets 90% on MMLU, so...

@TheBayesian wait what? share the link? i've not yet looked at it

GPT-4 can probably beat 91% with proper prompt engineering.

I have heard someone already did it using a combination of GPT-4 and some other model