A car driven by a human is an extension of that human (for better or for worse) - and we can relate to that, no matter how much steel, glass and rubber there is.
A car that drives itself is something alien, an abomination, a threat, a dangerous animal, small wonder we want to kill it - that is our most primal instinct.