Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?
Basic
6
Ṁ1452025
70%
chance
1D
1W
1M
ALL
Resolves "Yes" if, at time of closure, there is an entry on the SWE-bench leaderboard (https://www.swebench.com/) with score greater or equal to 90%.
Linked Questions:
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
67% chance
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2025?
19% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
53% chance
Will an AI agent system be able to score at least 40% on level 3 tasks in the GAIA benchmark before 2025.
97% chance
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2027?
72% chance
Will AI be Recursively Self Improving by mid 2026?
40% chance
Will an AI SWE model score higher than 50% on SWE-bench in 2024?
20% chance
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
AI resolves at least X% on SWE-bench assistance, by 2025?
Will an AI score over 80% on FrontierMath Benchmark in 2025
10% chance