Thanks! I don't know a lot about this but someone shared this local voice assistant in the comments:
https://github.com/KoljaB/LocalAIVoiceChat
Could be a good lead
It all seems your vision of JARVIS, which I share completely but haven't accomplished what you have, again excellent work and thank you for sharing, is very attainable. Probably combining your work along with KoljaB is very promising.