Years ago I worked at a large email service provider for bulk mailings on behalf of large customers and we took unsubscribes very seriously.
And for the really truly spam/scam emails, the unsub link is the least of your concerns since delivery and tracking pixels confirm the address is real and being used. The true spam usually doesn't even have an unsub link. In those cases mark as spam and hope that your email provider starts flagging them as spam before it ever makes it to your inbox in the future.
I'm an aggressive unsubscriber and 99% of the time it works. Very little junk flows into my inbox these days.