I've had a Tesla Model S for quite some time now. It cannot reliably adjust the high beam / low beam nor the windshield wipers. Those problems seem a bit easier than full self driving.
The phantom braking is the biggest deal: The car slams on the brakes in the middle of major highways in good weather just because it's a hot day and the camera saw a mirage and the car thinks it's about to drive off a cliff. This means the cruise control ("autopilot") on the car isn't even as reliable as "dumb" cruise control on a 20-year-old car, so I rarely use it.