Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?
10
120Ṁ195Dec 31
50%
chance
1H
6H
1D
1W
1M
ALL
Resolves "Yes" if, at time of closure, there is an entry on the SWE-bench leaderboard (https://www.swebench.com/) with score greater or equal to 90%.
Linked Questions:
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
People are also trading
Related questions
Best AI time horizon by February 2026, per METR?
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
45% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
60% chance
Will an AI achieve >80% performance on the FrontierMath benchmark before 2027?
62% chance
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2027?
69% chance
In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?
12/5/27
AI resolves at least X% on SWE-bench without any assistance, by 2028?
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
Will an AI system capable of doing tasks that take humans eight hours as determined by METR.org, exist by 2027
81% chance
Will any AI solve more than four of AI 2027 Marcus-Brundage tasks in 2025?
28% chance