If a web site owner misbehaves, no one concludes that the misbehavior reflects poorly on all the other web site owners because everyone understands that there is no way for the other web site owners to eject the misbehaving owner from their ranks. The fact that some of these web site owners are in fact very wealthy and own buildings is not relevant.

Similarly, effectivealtruism.org is just one non-profit in an ecosystem of dozens and does not own the trademark "effective altruism" or "effective altruist" (which might give it some ability to control how the trademark is used or by whom it is used).