HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by ranger_danger | Hacker News Reader
Full thread
ranger_danger
·
How is this so much faster than even GPU-based whisper?
View on HN
mrkn1
·
small, ONNX-optimized models designed specifically for low-latency CPU streaming, so it avoids overhead of large transformer arch and GPU memory transfers
Reply on news.ycombinator.com