Why would a local model for a consumer device need 17k tok/s?

Apple is better off building chips with generalizable TPUs (or equivalent) so they can upgrade/patch models.