By the way there is also another project called Whisper.cpp:

https://github.com/ggerganov/whisper.cpp

Which uses x8 less memory than the Python implementation for the tiny model. It would be a good idea to keep an eye on it since there are Python bindings planned on the roadmap:

https://github.com/ggerganov/whisper.cpp#bindings