MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?
7
37
แน362แน150
2026
16%
chance
1D
1W
1M
ALL
Get แน200 play money
More related questions
Related questions
MMLU 99% #2: Will SOTA for MMLU (average) pass 99% by the start of 2025?
15% chance
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
12% chance
Short-term AI 3.3: By June 2024 will SOTA on HumanEval be >= 99%?
5% chance
HumanEval 90% #3: Will pass@1 performance on the HumanEval benchmark be >= 90% by 2026?
84% chance
Will a SOTA open-sourced LLM forecasting system make major use of quasilinguistic neural reps (QNRs) before 2027?
31% chance
Will an open sourced SOTA LLM be trained on Intel hardware by 2024?
14% chance
When will no-calculator SOTA on the MATH dataset pass 90%?
BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?
65% chance
BIG-bench accuracy 75% #3: Will SOTA for a single model on BIG-bench pass 75% by the start of 2026?
64% chance
Will a Kolmogorov-Arnold Network based model achieve SOTA on some significant machine learning tasks in 2024?
20% chance