Will an autonomous agent resolve 90% of tasks on SWE-bench by 2025?
14
220Ṁ2546resolved Jan 1
Resolved
NO1H
6H
1D
1W
1M
ALL
Resolves "Yes" if, at time of closure, there is an entry on the SWE-bench leaderboard (https://www.swebench.com/) with score greater or equal to 90%.
Linked Questions:
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
🏅 Top traders
# | Name | Total profit |
---|---|---|
1 | Ṁ54 | |
2 | Ṁ32 | |
3 | Ṁ21 | |
4 | Ṁ16 | |
5 | Ṁ9 |
People are also trading
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
58% chance
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?
50% chance
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2027?
69% chance
In what year will AI achieve a score of 85% or higher on the SimpleBench benchmark?
3/17/32
AI resolves at least X% on SWE-bench without any assistance, by 2028?
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?
10/7/28
Will any AI solve more than four of AI 2027 Marcus-Brundage tasks in 2025?
28% chance
Will a smart agent pass our Turing test by the end of 2025?
56% chance
Will OpenAI models achieve ≥90% on SimpleBench by the end of 2025?
37% chance