Hacker News Reader

For an offline (non-streaming) model, 1x realtime is actually kind of bad, because you need to wait for the audio to be available before you can start processing it. So if you wait 10 seconds for someone to finish speaking, you won't have the result until 10 seconds after that.

You could use really small chunk sizes and process them in a streaming fashion, but that would impact accuracy, as you're significantly limiting available context.

I'd be interested to see how well it performs on something like an RPi. M1 is pretty beefy.

To be more precise the original comment said "M1 Max" which in itself is significantly beefier a bare "M1"