Hacker News Reader

I think this is largely unnecessary, can't things like TPUs handle the inference?

Using TPUs is expensive. Also some applications may need small latency

Putting all your speech/text onto cloud machines runs counter to e2e encrypted messaging.

I think you can get hardware like a TPU for consumer products?