Short-Term AI #2: By the end of June 2023, will SOTA on MMLU overall be >=85%?
13
270Ṁ9155
resolved Mar 14
Resolved
YES
Technical AI Timelines
Vincent Luczkow's Short-Term AI Predictions - Early 2023
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ53
2Ṁ37
3Ṁ36
4Ṁ20
5Ṁ19

People are also trading

OpenAI releases SOTA LLM by end of year?
38% chance
MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?
6% chance
BIG-bench accuracy 75% #3: Will SOTA for a single model on BIG-bench pass 75% by the start of 2026?
86% chance
What will be true of the SOTA AI on the FrontierMath benchmark, before 2026?
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
8% chance
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
2025 SOTA LLM releases cause Kokotajlo to increase AGI timeline estimate?
90% chance
BIG-bench accuracy 75% #4: Will SOTA for a single model on BIG-bench pass 75% by the start of 2027?
86% chance
BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?
87% chance
What will be true of the SOTA AI on the FrontierMath benchmark, before 2027?
Sort by:

Yep, it's over.

https://openai.com/research/gpt-4 it is over 85

Gpt4 will be out by then and whatever deepmind comes up with so no idea.

Short-Term AI #2: By the end of June 2023, will SOTA on MMLU overall be >=85%?, 8k, beautiful, illustration, trending on art station, picture of the day, epic composition

People are also trading

OpenAI releases SOTA LLM by end of year?
+4% 1d38% chance
MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?
6% chance
BIG-bench accuracy 75% #3: Will SOTA for a single model on BIG-bench pass 75% by the start of 2026?
86% chance
What will be true of the SOTA AI on the FrontierMath benchmark, before 2026?
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
8% chance
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
2025 SOTA LLM releases cause Kokotajlo to increase AGI timeline estimate?
90% chance
BIG-bench accuracy 75% #4: Will SOTA for a single model on BIG-bench pass 75% by the start of 2027?
86% chance
BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?
87% chance
What will be true of the SOTA AI on the FrontierMath benchmark, before 2027?
© Manifold Markets, Inc.•Terms•Privacy