Google Street View contains images, not point clouds. And based on my usage, it's updated roughly every year. This is not even close to sufficient for their self-driving cars.
You are wrong[1]. Streetview vans have been outfitted with LIDAR for years and generate 3D models as they drive. Just because you do not see the point-cloud data in your browser doesn't mean Google doesn't have it.
I'm sure someone built a hack that let you explore that directly.
http://callumprentice.github.io/apps/street_cloud/index.html
https://flowingdata.com/2014/03/26/reconstructing-google-str...