Is scale unnecessary for intelligence (<10B param human-competitive STEM model before 2027)?
18
1kṀ6380
2027
30%
chance

Resolves yes if before 2027, a neural net with <10B parameters achieves all of: >75% on GPQA, >80% on SWE-bench verified, and >95% on MATH

Arbitrary scaffolding allowed (retrieval over fixed DB is ok), no talking with other AI, no internet access. We'll allow up to 1 minute of time per question. We'll use whatever tools are available at the time to determine whether such an AI memorized the answers to these datasets; if verbatim memorization obviously happened, the model will be disqualified.

Get
Ṁ1,000
to start trading!
© Manifold Markets, Inc.TermsPrivacy