Yes, both software improvements and tailored hardware will continue to pay dividends (huge gains from TPUs, chips built specifically for inference, etc, even if the underlying process node is unchanged).

Slowing transistor scaling just gives us one less domain through which to depend on for improvements - the others are all still valid, and will probably be something we come to invest more effort into.