Yes, it's easy to trick human drivers with visual illusions and even cause a collision [1]. One example is the "invisible rope prank" where two people pretend to stretch a rope across a street, causing drivers to stop. I don't understand why it's a big deal that a machine learning system can be tricked by adversarial data but nobody cares that human drivers can also trivially be tricked.

https://www.youtube.com/watch?v=G_pAcIjqcuY

[1] The collision in this video is a bumper tap, nothing dramatic.