Not even close. There are a lot of people who cannot afford EVs. There are a bunch of people who cannot afford a new car at any price. Most of the people you see on the road driving 20-year-old cars are not doing it by choice.
There are also a lot of people who could afford an EV but do not have a place to charge one, because they live in an apartment complex without chargers or need to use street parking. No, charging your car at work is not a good solution because there would not be enough chargers if everyone had to drive EVs.
The burden of banning internal-combustion vehicles would disproportionately fall upon renters and the poor, who are also the people most affected by noise pollution.