On top of that, you have theory of mind. For example, you have 4 cars next to you, all of them with opaque windows that do not let you see the driver:
A) a loud sports car with a bunch of modifications, decals and racing related stuff
B) a grandma car with cat related stickers
C) an unmaintained car with collision damage, and loud music coming from it
D) a family station wagon with a baby on board sticker and other family related stuff
Your mind will process what it sees and quickly assign each one of those cars a different personality. A and C will likely be perceived as riskier cars, B and D will be likely perceived as safer cars. You will avoid A and C and remain unconcerned about B and D.
The problem with the self-driving cars right now is that they only perceive the road as bodies that move.