>"Your position is predicated on the idea that other's speech and property rights trump speech rights"

That's typically how it works. Paul can ban people from his site. The New York Times can prevent you from publishing an article on its pages. Neither infringes on your free speech rights, as understood by law and Western intellectual tradition.