Skip to main content
MANIFOLD
I go through the scaling book this week?
15
Ṁ100Ṁ554
resolved May 10
Resolved
NO

To my satisfaction (reading quickly without doing exercises doesn’t count, but no need to do literally every problem if some seem redundant to me. Also i reserve the right to skip the JAX chapters if i think they are not useful to me)

https://jax-ml.github.io/scaling-book/

Market context
Get
Ṁ1,000
to start trading!

🏅 Top traders

#TraderTotal profit
1Ṁ116
2Ṁ93
3Ṁ26
4Ṁ19
5Ṁ4
Sort by:

i'm halfway through chapter 3

I'm not sure how much knowing the math behind neutral networks contributes to practical knowledge about what they can do, or how to build one. The abstractions you get with tensor operations in pytorch are pretty good, you don't really have to know how they work to build any model with any training goal.

And that math looks really boring to study.

Karpathy has a pretty good set of videos on building and training transformer models. He explains how they work and train without getting into too much of the math underlying.

https://youtu.be/kCc8FmEb1nY?si=l4jZO-SKK33V5TdU

Https://youtu.be/l8pRSuU81PU?si=MxQdH641wCSf5RwD

no progress yet, quite bearish but should be ok

I wont bet at 90% bc this is a pretty serious book to go through i dont think it would be a failure to take more but this is an ambitious objective