What will be the highest score on the SWE-bench pro private set before 2027?
1
225Ṁ35
2027
65.3 %
expected
8%
Below 23%
8%
23 - 34%
8%
35 - 46%
8%
47 - 58%
16%
59 - 70%
25%
71 - 82%
20%
83 - 94%
8%
95 - 100%

Resolves according to: https://scale.com/leaderboard/swe_bench_pro_private.

For simplicity, the model must be evaluated and have its score revealed before 2027. If the model is released in 2026 but is not evaluated until 2027 it does not count.

Market context
Get
Ṁ1,000
to start trading!
© Manifold Markets, Inc.TermsPrivacy