What will be the highest score on the SWE-bench pro private set before 2027?
1
225Ṁ352027
65.3 %
expected1H
6H
1D
1W
1M
ALL
8%
Below 23%
8%
23 - 34%
8%
35 - 46%
8%
47 - 58%
16%
59 - 70%
25%
71 - 82%
20%
83 - 94%
8%
95 - 100%
Resolves according to: https://scale.com/leaderboard/swe_bench_pro_private.
For simplicity, the model must be evaluated and have its score revealed before 2027. If the model is released in 2026 but is not evaluated until 2027 it does not count.
This question is managed and resolved by Manifold.
Market context
Get
1,000 to start trading!
People are also trading
Related questions
When will SWE-bench be solved?
In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?
11/27/27
Best SWE-Bench Pro public score by June 30, 2026
AI resolves at least X% on SWE-bench without any assistance, by 2028?
Which LLM Maker will hold the top Safety Score for Spiral-Bench on https://eqbench.com/spiral-bench.html on Jan1, 2027?
[ACX 2026] What will be the highest score achieved on ARC-AGI-2 before 2027?
83.2
In what year will AI achieve a score of 95% or higher on the PhysBench leaderboard?
2036
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
Top SWE-Bench Pro score by Jan 1, 2027?
78.3
What will be the best GSOBench score by Dec 31, 2026?