The reasons don't seem that puzzling. Road traffic accidents are the cause of 1.2 million annual deaths (largely pedestrians and cyclists), the leading cause of death for ages 5-29, in addition to being a huge source of pollution.

The flipside of some of your points (like cars being good because you need one to get groceries) is that designing cities/etc. around cars and having insufficient public transport is a major cause of that need in the first place - particularly to the detriment of the many who can't afford or are otherwise unable to drive a car.

I don't think we can just rip cars out entirely, and definitely not all road vehicles as you seem to be implying ("poor immigrants to carry building supplies from the quarry to the factory then to the customer"), but I do think it'd be beneficial to minimize their use to where it's necessary, instead of as a default with associated costs subsidized by the general public.

You've identified a number of things that 'need' a car, but im guessing you, as well as everyone else uses their multiple household cars for other things.

And you could set up society so it doesn't actually need a car for a lot of these things.