AI resolves at least X% on SWE-bench without any assistance, by 2028?
26
2.5kṀ89262027
99%
X = 16
96%
X = 32
95%
X = 40
95%
X = 50
97%
X = 60
94%
X = 70
95%
X = 75
93%
X = 80
95%
X = 85
94%
X = 90
73%
X = 95
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000People are also trading
Related questions
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?
50% chance
By what factor will the cost for SotA SWE-agents drop from 2024 to 2025?
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2027?
69% chance
What will be the highest score achieved on SWE-Bench Verified in 2025?
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
42% chance
What will be the best performance on SWE-bench Verified by December 31st 2025?
Top Multi-SWE-bench score in 2025?
46.6
Top SWE-Bench Verified score in 2025?
85.4
Will OpenAI's next major LLM (after GPT-4) achieve over 50% resolution rate on the SWE-bench benchmark?
65% chance