I guess you'll have to choose wisely your annotations sources... If you see too much spam on 1 source, just unsubscribe. As said earlier, it's not so different of reddit/HN discuussions abouut content. The publisher may not even be aware of the discussion.