I think that one of Effective Altruism's axioms - that all lives are equally valuable - is not accepted by much of the population.
The number of people that would rush into a building to save a family member is likely far higher than the number of people that would rush into a building to save a stranger.