I'm using a Live Captions application in Linux (comfortably available via flathub too) that uses whisper.cpp locally to provide Live Captions for me to read after meetings and make notes.

If you can pair that with LLaMa 2 you will be fine and dandy.