It's pretty common for motorcyclists or bicyclists to make eye contact with a car driver who proceeds to pull out in front of them anyway.
This is probably in part from car driver brains not interpreting bikes as physical threats. It doesn't have to be deliberate. It can also be the driver scanning for "car" and not seeing "car".
A self driving car is on the other side of that size equation, but eye contact might also be assumed by a pedestrian to mean that you will stop. Especially if a "driver" makes eye contact who isn't driving.
In the end it's best to slow down and not assume. Humans often make dangerous assumptions, for example going around blind turns or over crests too fast to avoid something that might be there. Most of the time it's ok but eventually somebody gets killed. The rational thing to do is make the software safer than humans, not emulate them.