And if the app becoming faster doesn't mean anything because the app is waiting for user input the whole time, it was a lot of work for naught.

Perhaps restated: If the optimization cannot be felt (ie, impact on the product experience), it is not an optimization worth pursuing.