How much FLOP will be used to train the best language model with freely available weights on July 1, 2025?
Mini
4
Ṁ1.1k2025
1D
1W
1M
ALL
2%
<1e24
2%
[1e24, 3e24)
8%
[3e24, 1e25)
9%
[1e25, 3e25)
38%
[3e25, 1e26)
30%
[3e26, 1e27)
5%
[1e27, 3e27)
2%
[3e27, 1e28)
1.8%
[1e28, 3e28)
1.3%
[3e28, 1e29)
1.3%
>=1e29
Get Ṁ600 play money
Related questions
Related questions
End of pre-training era for language models: Will an LM fine-tune for more FLOPs than it is pre-trained for, before 2026
22% chance
Will a machine learning training run exceed 10^26 FLOP in China before 2027?
53% chance
Will a machine learning training run exceed 10^25 FLOP in China before 2025?
63% chance
Will a machine learning training run exceed 10^27 FLOP in China before 2028?
44% chance
Will a lab train a >=1e26 FLOP state space model before the end of 2025?
25% chance
Will a machine learning training run exceed 10^26 FLOP in China before 2026?
52% chance
How many FLOPs will go into training the first ASL-3 model?
At least one of the most powerful neural nets at end of 2026 will be trained using 10^27 FLOPs
77% chance
Will a machine learning training run exceed 10^26 FLOP in China before 2025?
31% chance
Will a machine learning training run exceed 10^26 FLOP in China before 2028?
64% chance