run "set timer" and "what's the weather" and "turn on the lights" through some regexes as a first pass and save the LLM for the complicated stuff. actually, with some caching they can probably cut costs pretty heavily there too.
I’m guessing they are already doing this. Adding an LLM is asking to add a very expensive thing to the long tail of queries which likely cannot be cached.