Moore's Law is a self-fulfilling prophecy derived from the value of computation. If a given computation does not provide enough value, it might not be invested with enough resources to benefit from Moore's Law.

When scaling saturates, less computationally expensive models would benefit more.