MANIFOLD
Do scaling laws happen because models experience a ton of tiny phase changes which average out to a smooth curve?
33
Ṁ1kṀ1.3k
Dec 31
39%
chance

Problem 5.31 from @NeelNanda's 200 COP.

"D* 5.31 -  Hypothesis: The reason scaling laws happen is that models experience a ton of tiny phase changes, which average out to a smooth curve because of the law of large numbers. Can you find evidence for or against that? Are phase changes everywhere?"

Resolves to the best evidence available by the end of 2024.

Market context
AI
AI Safety
Mechanistic interpretability
Technical AI Safety
Get
Ṁ1,000
to start trading!
Sort by:

This seems ~vaguely plausible but I think proving it would require a level of understanding of the individual circuits that we won't have by 2025.

@vluzko End of decade?

I'm bullish but think the odds are less than 50%

People are also trading

© Manifold Markets, Inc.•Terms•Privacy