![](/_next/image?url=https%3A%2F%2Ffirebasestorage.googleapis.com%2Fv0%2Fb%2Fmantic-markets.appspot.com%2Fo%2Fdream%252FaRCfxCw4BA.png%3Falt%3Dmedia%26token%3D28de5778-4bcf-47d0-8be4-5c7b71656cee&w=3840&q=75)
Do scaling laws happen because models experience a ton of tiny phase changes which average out to a smooth curve?
Basic
32
Ṁ1.0k2025
48%
chance
1D
1W
1M
ALL
Problem 5.31 from @NeelNanda's 200 COP.
"D* 5.31 - Hypothesis: The reason scaling laws happen is that models experience a ton of tiny phase changes, which average out to a smooth curve because of the law of large numbers. Can you find evidence for or against that? Are phase changes everywhere?"
Resolves to the best evidence available by the end of 2024.
Get Ṁ600 play money
Sort by: