A cyclist may run a stop sign and ride through a crosswalk very close to a pedestrian. They do not consider this dangerous behavior, because they are in control and they know it. Pedestrians (even those with biking experience) may not have inherent trust the cyclist is in control or aware, and this instills fear. The cyclist rides away without even knowing they scared the pedestrian, while the pedestrian feels they were endangered. These interactions then reinforce stereotypes.
My point is that _everyone_ is acting selfish at intersections [0], and nobody thinks they are a threat because they believe they're in control. I think things get most heated with (against) cyclists because while most cyclists are also pedestrians and drivers, the reverse is not true.