Don't take action without feedback is a pretty golden rule.

At least send an email to confirm that they have been unsubscribed.