Why is Claude 3.5 Sonnet such a good model for its size?
Basic
2
120
2026
58%
Task vectors like golden gate Claude
·
1d
49%
Offline policy learning RLHf
·
1d

Claude sonnet (3.5) is a relatively small model (estimated to be 5e24 FLOPs). Yet it beats larger models on GPQA, LMSYS, and many other industry standard benchmarks. While it can’t be known that this market can resolve, it’s possible that academics and OSS will learn in the coming years what was done to achieve this high quality model.

Get Ṁ600 play money