EVs don't have any less impact on road deterioration and maintenance needs. If anything they cause more damage as a result of their higher average mass and acceleration.
Whether a per-mile/km tax is the right approach or even feasible is another question, but I don't think it's entirely wrong to be considering some sort of road usage tax for EVs that's proportional to the fuel levy.