Why does it matter?
If power is the bottleneck, frontier AI progress depends as much on energy logistics as model research.
Direct quote
Power constraints will likely become the primary bottleneck for AI supercomputer growth, driving a shift toward distributed training across multiple sites. This evolution could change how we measure AI training capabilities—from focusing on individual AI supercomputers to assessing companies' aggregate compute capacity.
Trends in AI Supercomputers