For people with multiple cars, it's not much of an issue for things to be just a little off (the plastic, the handles, the seat fabrics, steering wheel alignment, shavings on the dash board, etc.)--the Tesla is a show car and treated as such. For people who would use the Model 3 as their primary vehicle, the experience is subpar for its current price point compared to all other vehicles in its class (entry level luxury vehicles) or engine type (other EVs) and this is one of the difficulties Tesla will run into once it actually starts public shipments of the car. There's enough competition out there now that being an electric isn't enough to justify a premium price; the car has to have premium interiors as well.
Source: my boss has all of them. I ride shotgun quite frequently.
Luxury car buyers, fundamentally, are buying the logo, and the handful of obviously markers inside the car that tell people it's a Lexus or whatever. They aren't buying fit and finish, even if they think they are. Tesla buyers are no different: they want a Tesla, not a Lexus or a Mercedes.
I'm sure to the trained eye a Lexus has a different build than a Tesla, just as cheeses and wines are different. That's not what drives sales.
They want comfort, first and foremost. A Tesla nameplate means nothing on your daily commuter car if it's not pleasant to drive. A Lexus or a Mercedes, even at the entry level, provides a comfortable ride. The interiors feel luxurious. A Tesla does not. And that's the problem--it charges an entry-level luxury price but doesn't provide an entry-level luxury ride. Subjectively, I find that the Tesla's interiors aren't even as comfortable as the Bolt, and I'm not even including the many QC issues they have in that assessment.
The Tesla name might bring potential buyers to the dealership, but when you're targeting a road warrior, the interior is what sells the car.
They do look great, but they feel cheap.