Not quite. EVs reduce direct pollution, but there are still a lot of negative externalities. There are obvious ones relating to the manufacture and also to then still requiring energy.
But car culture itself has all sorts of issues, no matter the drive train: it encourages bad urbanism and sprawl (with large environmental impact), encourages inefficient land use via extensive parking, it taxes the infrastructure, it encourages bad health, and also some direct accidents.