No it's not.
It's a basic human right not to be formally condemned by a government or government-like body without legal due process.
It's not a basic human right to be free from all judgement by your peers without due process. If I think my neighbor's a dick, I don't need to hold a trial by jury to decide if I'm allowed to disinvite him from my BBQ.
In this case, it seems like a number of people in this community think Geoff is a first-rate asshole for publicly-known reasons. I have no knowledge of whether that's true or not - I've not reviewed the evidence. But a lot of people believe it, and those people don't want papers authored, co-authored, or believed to be authored, by Geoff in their conference. That seems reasonable, at least for people who believe the original allegations against Geoff.
(Disclaimer: there's some other bad stuff mentioned, like harassment of the author and some shitty assumptions that her own work was secretly Geoffs, and that's to be condemned, but that's separate from the main thrust of this post.)