You can try my C/C++ port of Whisper:

https://github.com/ggerganov/whisper.cpp

No dependencies, no Python, runs efficiently on the CPU.