Is this really that big of a deal? If it's a choice between allowing anyone to unsubscribe someone (low annoyance factor and rare) versus requiring that all users who wish to unsubscribe log in (annoying and possible can spam violation),then it makes sense to choose the latter.