I agree that it's a slightly more vulnerable feeling than driving myself, but I still feel far less vulnerable than taking public transit or walking. And when you factor in risk of a crash, it's also safer than Uber or driving myself.
I don't think Waymos will often be targeted by criminals for anything besides vandalism, with 20+ cameras and potential remote monitors the risk:reward ratio is much worse than other options.