Do scaling laws happen because models experience a ton of tiny phase changes which average out to a smooth curve?
30
1kṀ1229
2030
61%
chance

Problem 5.31 from @NeelNanda's 200 COP.

"D* 5.31 -  Hypothesis: The reason scaling laws happen is that models experience a ton of tiny phase changes, which average out to a smooth curve because of the law of large numbers. Can you find evidence for or against that? Are phase changes everywhere?"

Resolves to the best evidence available by the end of 2030.

Get
Ṁ1,000
to start trading!
© Manifold Markets, Inc.TermsPrivacy