Top Multi-SWE-bench score in 2025?
19
10kṀ29kDec 31
46.2 %
expected1H
6H
1D
1W
1M
ALL
3%
0 - 19%
40%
20 - 39%
37%
40 - 59%
14%
60 - 79%
7%
80 - 100%
SWE-bench is a great AI benchmark, but it is Python-only. Multi-SWE-bench is the same thing with multiple programming languages: C, C++, Java, JavaScript, TypeScript, Go, Rust.
Claude 3.7 Sonnet based agent achieved a score of 19% in 2025-03-29, which is currently the best score. The score will be rounded. ("Rounding half up" to be exact, see Rounding.)
The resolution will be primarily from the official leaderboard, but other announcements from reputable organizations will be considered.
See also /SG/top-swebench-verified-score-in-2025
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000People are also trading
Related questions
When will SWE-bench be solved?
What will be the best performance on SWE-bench Verified by December 31st 2025?
AI resolves at least X% on SWE-bench without any assistance, by 2028?
What will be the best score on Cybench by December 31st 2025?
What will be the highest score achieved on SWE-Bench Verified in 2025?
Top FrontierMath score in 2025?
57.3
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
What will be the best score (5/5 reliability) on ZeroBench by December 31st 2025?
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
42% chance
Top SWE-Bench Verified score in 2025?
85.4