Cost. The cost of an Uber is way too much for daily travel (vs owning your own car or public transport).
A human-driven taxi needs to pay the driver's salary within an 8 hour shift. An autonomous taxi can run (almost) 24/7, 365 days a year. Which do you think will be the cheaper fare?
Another scenario is someone simply renting out their own car as an autonomous taxi whenever they aren't using it themselves (which is most of the time). Then it'll always be cheaper than current-day taxis because it's just a low-effort bonus source of income to the car owner.