That's pretty much my experience as well.
Even something as dumb and simple as setting timers is getting messed up some times. To the point where I'm just considering buying a hardware multi-timer.
I'm not sure how good Google is at this but it seems this sort of technology has hard limits anyway. It's already hard for humans to understand each other so I wonder if all of this isn't just a giant distraction and a big waste of time.