>Assuming we don't require physical failsafes though and truly airgap driving systems from any network connectivity (which we won't, I guarantee it) there's definitely a worry on the state level actor front.

I think it's quite plausible that any autonomous vehicle will have something akin to a big red STOP button, just like most other automated machinery.