At least one of the most powerful neural nets at end of 2026 will be trained using 10^27 FLOPs

AI Compute•AI•Machine Learning

270

Ṁ3.1K

Ṁ1.1K

2027

77%

chance

ALL

Resolves YES if at least one of the most powerfull neural nets publicly known to exist by end of 2026 was trained using at least 10^27 FLOPs. This is ~30 exaFLOP/s years. It does not matter if the compute is distributed, as long as one of the largest models used it. A neural net which uses 10^27 FLOPs but is inferior to other models does not count. Low precision floating point such as fp32, fp16, or fp8 is permitted.

Resolves NO if no such model exists by end of 2026.

If we have no good estimates of training compute usage of top models, resolves N/A.

Show less

Get Ṁ200 play money

Related questions

At least one of the most powerful neural nets at end of 2030 will be trained using 10^26 FLOPs

89% chance

Will a machine learning training run exceed 10^26 FLOP in China before 2027?

51% chance

At least one of the most powerful neural nets at end of 2030 will be trained using 10^27 FLOPs

89% chance

Will a machine learning training run exceed 10^26 FLOP in China before 2026?

35% chance

Will a machine learning training run exceed 10^25 FLOP in China before 2027?

77% chance

Neural Nets will generate coherent 20-min films by the end of 2025 (less strict criteria market, $1000M subsidy)

64% chance

Will a lab train a >=1e26 FLOP state space model before the end of 2025?

27% chance

Neural nets will out-perform researchers on peer review by end of 2025.

18% chance

Will a machine learning training run exceed 10^25 FLOP in China before 2025?

49% chance

Will a machine learning training run exceed 10^26 FLOP in China before 2028?

Sort by:

> We used Multislice Training to run what we believe to be the world’s largest publicly disclosed LLM distributed training job (in terms of the number of chips used for training) on a compute cluster of 50,944 Cloud TPU v5e chips (spanning 199 Cloud TPU v5e pods) that is capable of achieving 10 exa-FLOPs (16-bit), or 20 exa-OPs (8-bit), of total peak performance.
- https://cloud.google.com/blog/products/compute/the-worlds-largest-distributed-llm-training-job-on-tpu-v5e

Note that for resolution purposes, I will permit 8-bit precision if they can productively utilize it in training.

If I'm doing my math right, it would take ~18 months for this to satisfy the requirements of this market. (Assuming they could get full peak utilization out of it.)