Why does it matter?
This much compute would keep pushing frontier AI progress toward actors with enormous infrastructure capacity.
Direct quote
The United States accounts for about three-quarters of total AI supercomputer performance, with China in second place at 15%. Meanwhile, traditional supercomputing powers like the UK, Germany, and Japan now play marginal roles in AI supercomputers. If the observed trends continue, the leading AI supercomputer in 2030 will achieve 2 x 10^22 16-bit FLOP/s, use two million AI chips, have a hardware cost of $200 billion, and require 9 GW of power.
Trends in AI Supercomputers