All non-transportation fuel uses account for a total of only 33% of crude oil consumption. Of the other 2/3rd, gasoline accounts for 43%. So yes, switching to EVs would have a massive impact, and probably put unconventional sources of oil (eg. Venezuela and Alberta) out of business. As for diesel, EV truck sales are starting to take off too.
https://www.eia.gov/energyexplained/oil-and-petroleum-produc... https://www.iea.org/reports/global-ev-outlook-2025/trends-in...