I take both waymo's and lyft/uber all the time in sf and waymo's are way slower. I'd estimate it at 10-15% slower. Once the novelty of a waymo wears off you realize that they drive like a high anxiety teenager and going 15 mph on a 15 mph road, coming to gentle full stop at every stop sign, and being very tentative on turns and passing people all add up to a very slow ride.
You're right though it definitely feels safer.