Short-Term AI #3: By the end of June 2023, will SOTA on MATH be >= 70%?
30
570Ṁ2544resolved Jul 1
Resolved
YES1H
6H
1D
1W
1M
ALL
Current SOTA is ~50%: https://paperswithcode.com/sota/math-word-problem-solving-on-math
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ201 | |
| 2 | Ṁ60 | |
| 3 | Ṁ58 | |
| 4 | Ṁ37 | |
| 5 | Ṁ26 |
People are also trading
Related questions
What will be true of the SOTA AI on the FrontierMath benchmark, before 2026?
MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?
6% chance
BIG-bench accuracy 75% #3: Will SOTA for a single model on BIG-bench pass 75% by the start of 2026?
86% chance
What will be true of the SOTA AI on the FrontierMath benchmark, before 2027?
What will be true of the SOTA AI on the FrontierMath benchmark, before 2028?
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
8% chance
BIG-bench accuracy 75% #4: Will SOTA for a single model on BIG-bench pass 75% by the start of 2027?
86% chance
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?
87% chance
SOTA AI at EOY 2026 a reasoning model?
65% chance