Codebuff solves at least 40% of issues on SWE-Bench by March 31, 2025
5
1kṀ1386
resolved Apr 10
Resolved
NO

(This market is AI-generated but I read it and it seems right)

This market predicts whether Codebuff will achieve a 40% success rate on the SWE-Bench dataset, which is a benchmark of human-selected program issues.

Resolution will be based on official results published on the SWE-Bench dataset or Codebuff project's official channels.

References:

Technical AI Timelines
Math
Computing
Programming
Cryptography
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ555
2Ṁ1

People are also trading

What will be the best performance on SWE-bench Verified by December 31st 2025?
Will rw_search be able to replace >50% of mathlib proofs by 2025-11-26?
19% chance
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?
50% chance
AI resolves at least X% on SWE-bench without any assistance, by 2028?
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?
12/5/27
What will be the highest score achieved on SWE-Bench Verified in 2025?
What will be the best score on Cybench by December 31st 2025?
Will Alphaproof achieve >30% performance on the FrontierMath benchmark before 2026?
16% chance
Top SWE-Bench Pro public dataset score by January 1, 2026
48.5
Sort by:

No model went above 40%, thus Codebuff did not too.

Is this SWE-Bench or SWE-Bench verified?

@CampbellHutcheson the full one.

Nice. We can do it!

I assume you mean the full SWE bench. We're more likely to work on the Lite or Verified subset.

@JamesGrugett So, did you?

People are also trading

What will be the best performance on SWE-bench Verified by December 31st 2025?
Will rw_search be able to replace >50% of mathlib proofs by 2025-11-26?
19% chance
Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?
50% chance
AI resolves at least X% on SWE-bench without any assistance, by 2028?
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?
12/5/27
What will be the highest score achieved on SWE-Bench Verified in 2025?
What will be the best score on Cybench by December 31st 2025?
Will Alphaproof achieve >30% performance on the FrontierMath benchmark before 2026?
16% chance
Top SWE-Bench Pro public dataset score by January 1, 2026
48.5
© Manifold Markets, Inc.•Terms•Privacy