Even just paying for the roads for these cars to drive on is a challenge with the lack-of-density they require. So many suburbs with large lot sizes just learn to live with the potholes.
People writing in other comments about cost of roads, new and repair - it all will change with autonomous road paving hardware.