Ask HN: Best back end to run models on Google TPU?

8 pointsvood0 comments

So, I got Pixel 10 Pro, and I'd like to run parakeet (or whisper) model on it for voice to text. I'm building an ai dictation app (aidictation.com). I'm struggling to find a way to run this model on device. I have to reserve to use groq API, which is suboptimal.

Any recommendations?

View on HN