It does remain to be seen how well Tesla will trust the general public with this level of improved autonomy. As you get closer and closer to the uncanny valley where things just appear to work, you get into the more tricky situations that truly befuddle humans and machines alike.
NHTSA scrutinizes crashes that involve anything close to Autopilot and FSD quite heavily. Aside from one or two incidents they've had complaints about, none of them have risen to the point where they had to put their foot down. Admittedly, Tesla were a big bunch of jerks about how they handled the situation, but still, these were isolated incidents with clear misuse from the driver's part.
I agree with you, in that Musk is overly optimistic (no shit, he's been saying this would be ready in 2018, and it's unclear if it will be in 2021). But he's also quite well informed of the facts on the ground, and is clearly aiming for the moonshot-winner-take-all prize by skipping Lidar and high-precision mapping. That might be a gamble, but need not be an inherently dangerous one, depending on how Tesla handles the super-grey areas around the uncanny valley, where the system appears to work, but really isn't worth risking your life upon. To some, it's already there, as you can see from idiots sleeping in their Teslas while on Autopilot. But again, outside of a couple of incidents over years and millions and miles, the rate of catastrophic failure (accidents) has been surprisingly low.