80% on SWE-Bench Verified by Jan 1 2025
29
1kṀ14kresolved Jan 2
Resolved
NO1H
6H
1D
1W
1M
ALL
Someone will achieve 80% on SWE-Bench by Jan 1 2025. Current SoTA is ~20%. Must announce result by Jan 1.
Current SoTA now 30% Aug 12.
https://arxiv.org/pdf/2310.06770
market is now 80% on SWE Bench verified by EOY.
https://openai.com/index/introducing-swe-bench-verified/
Given the uncertainty in this market with respect to resolution criteria, I have sold all my shares and will merely judge it.
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ581 | |
| 2 | Ṁ379 | |
| 3 | Ṁ294 | |
| 4 | Ṁ262 | |
| 5 | Ṁ125 |
People are also trading
Related questions
What will be the best performance on SWE-bench Verified by December 31st 2025?
What will be the highest score achieved on SWE-Bench Verified in 2025?
Top Multi-SWE-bench score in 2025?
46.4
Top SWE-Bench Verified score in 2025?
85.5
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
25% chance
When will SWE-bench be solved?
In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?
10/7/28
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
AI resolves at least X% on SWE-bench without any assistance, by 2028?
Will I be able to bench my own weight by the end of 2025?
73% chance