Doesn't that depend on how orchestrated that decision-making is, and who's making the decisions (on behalf of others)?
When many instances co-ordinate to block an instance based on activism (Fediblock), they are censoring everyone on the targeted instance, many of whom may be innocent.
People deciding "whether they want to follow someone" is completely different from what's happening here.