the goal is no wheel , just set a destination and put your seatbelt . From that perspective it would make sense to put least amount of effort on driver monitoring.
If that’s the goal we should invest in buses, because you essentially described buses.
Buses don't take me from my home to where I want to go, they carry me between fixed stops. The parent commenter has described a taxi.
You can't set destination with buses, also they usually don't have seatbelts. I have no idea where you are finding any similarity here. If anything it would be similar to an Uber.
That's like saying if the eventual goal is realistic telepresence through BCI, we should just go ahead and remove the seatbelts to quit wasting effort on things that won't be in the final vision.