Well, this works the other way around too, right? If you invite, or accept applications from, someone who is primarily noted for {bar}, then whatever your name, official agenda, or spokespeople say, you are now hosting a conference tolerant or supportive of {bar}.

You seem to be making a declaration that acts are inherently political, and I'm all for that. It's just that the standard works both ways.