Power plants are much more efficient in converting fuel to energy than the combustion engines in vehicles, so, even if we use fossil fuel to generate the power that electric vehicles need, we will be in a better spot than the one we are right now.
(And I'm not even considering the energy that we need to expend to refine the oil to make fuel that vehicles can use).