Claude sonnet (3.5) is a relatively small model (estimated to be 5e24 FLOPs). Yet it beats larger models on GPQA, LMSYS, and many other industry standard benchmarks. While it can’t be known that this market can resolve, it’s possible that academics and OSS will learn in the coming years what was done to achieve this high quality model.