They're "permanent" in that they're not controlled by the site owners. But without effective moderation, a public channel of annotations will become unusable, so spam and trolls must be dealt with effectively.