The main reason is the performance. Many early EV's had blistering acceleration and this was reflected it the number of claims insurance companies were getting.

The torque/hp figures also do not help since they are in correlation with abuse and thus higher crash rates. e.g. a Tesla just for liability is significantly more expensive due to hp, you get nothing for crashing it, same weight Model 3 vs ID.3 both 60kwh but 205 vs 150kw is 115 vs 85 euros as a first owned car for a 35 year old and it drops quickly with less power (rates also differ for where you live, don't try to insure an audi with specific trim of wheels on some cities).