He's not "violating" someone's freedom to listen to a talk, but rather he hates the guy and wants him gone. At least he's doing something about it