Why does it matter?
Large efficiency gains would make the same capabilities cheaper and harder to regulate by compute alone.
Direct quote
If algorithmic progress continues at the upper bound of current estimates, models could achieve equivalent capabilities with 10-100x less compute by 2030.
International AI Safety Report