Short-Term AI #2: By the end of June 2023, will SOTA on MMLU overall be >=85%?
13
270Ṁ9155
resolved Mar 14
Resolved
YES
Technical AI Timelines
Vincent Luczkow's Short-Term AI Predictions - Early 2023
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ53
2Ṁ37
3Ṁ36
4Ṁ20
5Ṁ19

People are also trading

MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?
6% chance
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
8% chance
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
BIG-bench accuracy 75% #3: Will SOTA for a single model on BIG-bench pass 75% by the start of 2026?
86% chance
What will be true of the SOTA AI on the FrontierMath benchmark, before 2026?
BIG-bench accuracy 75% #4: Will SOTA for a single model on BIG-bench pass 75% by the start of 2027?
86% chance
BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?
87% chance
What will be true of the SOTA AI on the FrontierMath benchmark, before 2027?
What will be true of the SOTA AI on the FrontierMath benchmark, before 2028?
SOTA AI at EOY 2026 a reasoning model?
71% chance
Sort by:

Yep, it's over.

https://openai.com/research/gpt-4 it is over 85

Gpt4 will be out by then and whatever deepmind comes up with so no idea.

Short-Term AI #2: By the end of June 2023, will SOTA on MMLU overall be >=85%?, 8k, beautiful, illustration, trending on art station, picture of the day, epic composition

People are also trading

MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?
6% chance
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
8% chance
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
BIG-bench accuracy 75% #3: Will SOTA for a single model on BIG-bench pass 75% by the start of 2026?
86% chance
What will be true of the SOTA AI on the FrontierMath benchmark, before 2026?
BIG-bench accuracy 75% #4: Will SOTA for a single model on BIG-bench pass 75% by the start of 2027?
86% chance
BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?
87% chance
What will be true of the SOTA AI on the FrontierMath benchmark, before 2027?
What will be true of the SOTA AI on the FrontierMath benchmark, before 2028?
SOTA AI at EOY 2026 a reasoning model?
71% chance
© Manifold Markets, Inc.•Terms•Privacy