I rode in a Model Y last year and just could not believe the mistakes it was making. Disappearing and reappearing cars; the semi in front of us was apparently straddling the lane line for a few miles; somehow an early-2000s Dodge Ram was classified as a small sedan – the list goes on, and this was only a ~10-minute ride. I would be absolutely mortified if a product of mine ended up in front of a customer in that state.
That said, would I ever trust my life to a system like that? No.
But the display itself serves basically no purpose besides looking cool, and it just fails pretty badly at that. Also yeah, it made me maybe a little more nervous about being on the road with a Tesla than it should’ve…
If anything, if you've got self-driving on in a Tesla, you're not being nervous enough. :)
It has limited accuracy due to the poor processing power of the Intel Atom chips they used to put in the infotainment screen - they didn't even have anti-aliasing on the car models due to the poor processing power, they needed to make sure the rest of the infotainment experience remained snappy. (note this is not the same chip as what the FSD computer uses).
The "park assist" visuals[0] are closer to what the system actually knows about its surroundings from the cameras, but they're only enabled at low speeds for now (likely still due to processing power of the infotainment screen).
That a car can disappear and reappear in the autopilot's knowledge of the world is really weird to me. I would have thought that each car would be tagged as an object that has physical attributes such as "can't teleport".
To see what FSD is actually seeing see the new parking system that shows the voxels, the backend is like that but they cant afford the budget on the CPU to render that at high speed for visualization