This is why I think the personal Jarvis for everyday use won’t eventually be in the cloud. It can already be done on local hw as you are demonstrating and cloud has big downsides around privacy and latency and reliability.
Like you said it’s difficult to keep up with and to me it feels very much like open source stuff might win for inference.