Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?
3
14
Ṁ40Ṁ120
2025
57%
chance
1D
1W
1M
ALL
Resolves "Yes" if, at time of closure, there is an entry on the SWE-bench leaderboard (https://www.swebench.com/) with score greater or equal to 90%.
Linked Questions:
Get Ṁ600 play money
Related questions
Will an autonomous personal AI agent, capable of managing daily affairs, be available by the end of 2024?
23% chance
AI resolves at least X% on SWE-bench without any assistance, by 2028?
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
Will an autonomous AI agent become a self-made millionaire by the end of 2024?
12% chance
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2025?
25% chance
Will any AI be able to formalize >=90% of IMO problems by the start of 2025?
25% chance
AI resolves at least X% on SWE-bench assistance, by 2025?
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2027?
71% chance
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
67% chance
Will AI fully automate Cochrane-style systematic reviews by end of 2026?
37% chance