This device that just sits and listens all the time and interrupts ... that's nothing like I use LLMs now. That's a completely different mode of operation / my tolerance for mistakes would be near 0 with that.
It's not clear to me if an LLM can even DO these things conversationally well enough to work / not be a nuisance.
Siri might be the best example, you use it a few times, it's useless a few times and then I just use it to set timers and forget about it otherwise.