You know you can make that complaint about any tool or technology, right?
"Gosh why do I have to follow all these rules and observe traffic lights to drive a car?" (something that actually intimidates me, in fact, because I've never driven a car.)
"Why do I have to worry about cutting or burning myself or someone else while trying to cook a meal?"
"Why are all these procedures and protocols, like schools and banks and taxes, required to function at all in contemporary society?"
Until computers advance to the point of being artificially intelligent familiars that can figure out exactly what we want from a simple vocal command and do something even better, we're gonna have to put in a little effort from our end to make them work the way we want them to.