And this definitely matters. The energy required to stop a vehicle is a linear correlation to the mass, and our ability to stop vehicles quickly still relies on creating heat using friction; it has not progressed nearly as quickly as our ability to accelerate vehicles.
We've had a lot of innovation in braking - including better tire compounds, disc brakes, anti lock, better brake compounds and design, etc. Most people just don't talk about them or compare braking stats.
Consumer vehicles now able to accelerate to 60 mph in 2 seconds, but it can still take them up to 3 seconds to get back to 0.
Note: These are based on a safety article from Edmonds, 'Keep your Distance', who uses a distance of 132' with a braking time of 3.1 seconds. They appear to be measuring a car at the lighter end of the spectrum, as other articles I found still refer to 200'+ at the heavy end of the spectrum.
Average braking distances for any passenger vehicle class isn't even close to 200 feet, not even for pickup trucks.
https://www.consumerreports.org/cars/car-safety/best-and-wor...
Many of the fastest cars also have the best brakes. There are a number of them that can even get under 100'.
https://www.motortrend.com/features/20-best-60-to-0-distance...
If we want to talk trends in poor braking, we can look at Tesla and EVs in general. In many cases EVs select low rolling resistance tires with poor performance. The top quality low rolling resistance tires can be good, but many EVs have tight margins and lower end tires with less grip. It's not just weight. You can compare similar weight vehicles like a Tesla and a Silverado, and the conventional vehicle generally brakes better.
AFAIK the limiting factors are tire grip, ABS control and of course mass.
Even then though, the travel of the brake pedal may be such that the time to full braking power is significant. Fortunately brakes are fairly straightforward and getting them back to good performance usually isn't a complex or expensive process.