MMLU 99% #2: Will SOTA for MMLU (average) pass 99% by the start of 2025?
8
190Ṁ457resolved Jan 6
Resolved
NO1H
6H
1D
1W
1M
ALL
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ42 | |
| 2 | Ṁ39 | |
| 3 | Ṁ0 | |
| 4 | Ṁ0 |
People are also trading
Related questions
MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?
6% chance
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
8% chance
Will Claude 4 achieve over 95% on the MMLU-Pro benchmark by end of 2025?
12% chance
BIG-bench accuracy 75% #3: Will SOTA for a single model on BIG-bench pass 75% by the start of 2026?
86% chance
BIG-bench accuracy 75% #4: Will SOTA for a single model on BIG-bench pass 75% by the start of 2027?
86% chance
BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?
87% chance
By 2026, will it be standard practice to sandbox SOTA LLMs?
28% chance
Will a text model achieve 100% performance on the MMLU in five years?
28% chance
Will the transformer architecture be replaced in SOTA LLMs by 2028?
65% chance