Short Term AI 3.2: By June 2024 will SOTA on MATH be >= 90%?
15
45
Ṁ731Ṁ290
Jun 2
14%
chance
1D
1W
1M
ALL
Benchmark. At market creation SOTA is 84.3% by GPT-4 Code Interpreter.
Other short-term AI 3 markets:
Get Ṁ200 play money
Related questions
Short-term AI 3.3: By June 2024 will SOTA on HumanEval be >= 99%?
5% chance
MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?
16% chance
Short Term AI 3.1: By June 2024 will an AI be mostly/entirely credited with a scientific discovery?
5% chance
MMLU 99% #2: Will SOTA for MMLU (average) pass 99% by the start of 2025?
15% chance
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
12% chance
When will no-calculator SOTA on the MATH dataset pass 90%?
BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?
65% chance
BIG-bench accuracy 75% #3: Will SOTA for a single model on BIG-bench pass 75% by the start of 2026?
64% chance
BIG-bench accuracy 75% #2: Will SOTA for a single model on BIG-bench pass 75% by the start of 2025?
60% chance
SoAI 23 3/10: Will Self-improving Al agents crush SOTA in a complex environment (e.g. AAA game, tool use, science)?
29% chance