Why does it matter?
Enough chips for 100,000x GPT-4 compute would keep hardware supply from being the main brake.
Direct quote
Existing trends and technical possibilities in chip production suggest that it is possible to train AI systems with 100,000x more training compute than GPT-4 (the leading language model of 2023) by 2030.
International AI Safety Report