I don't think EA institutions argue that they have the One True Answer. They just often give recommendations - "eg. if you care about maximizing QALY overall, we recommend charities X, Y, and Z." If I don't care about QALY maximization, fine. But if I do, why would I not listen to the recommendations?