In my little race car, I have no radio, no air conditioner, no carpets, roll bars, bucket seats and harnesses. You're well aware you're operating machinery, and like driving a telihandler or some other machine, you don't let yourself get distracted. Phone goes in the pocket and you're absorbed with the machine you're operating.
Yet in my daily driver I often find myself fiddling with spotify, or running through contact lists for phone calls via the head unit, playing with hvac settings, etc.
While I don't know if consumers would accept the removal of comforts for safety sake, I feel that I'm a safer driver in my bare-bones vehicle with less overall distractions and conveniences. Ultimately like with everything, I guess it comes down to more education being required.