Mind sharing your local setup for Mac?
I have enough RAM on my Mac that I can run smaller LLMs locally. So for me the whole thing stays local
It's been a while, so I don't know if it's going to work because of the Nemo toolkit ASR numpy dependency issues.
I use it for Linux using whisper CPP and it works great