Hacker News Reader

Is there any improvement to GPU inference at all?

CPU inference is not cost effective for my use-case

If you have a good GPU then you don't need `whisper.cpp`. Best use case currently is if you are running on Apple Silicon.