>> Are you at fault because you have to, in theory, keep in control at all times?
Yes...
We already have examples of this with machinery that is automated. The Humans in charge of these automated machines are responsible for monitoring them, and have things like emergency shut downs, and various other safety protocols to shut them down when (not if When) they do unexpected things.
Machines are machines, they fuck up. The manufacturers are not held liable because the know these types of abnormal conditions exist they is why they have the safety protocols and human minders.
An example of this is the auto manufacturer i believe in TN or TX that did not train the operators properly on the safe way to operate, and lock out a machine, this failure to train lead to human injury. The manufacturer of the robot was not liable, the company that failed to train the human staff was.