I try to do this too but Slack updates the favicon when in do not disturb. It’s like catnip, plenty of dark patterns
There's an option in the Preferences to "Show a badge on Slack's icon to indicate new activity" which, when unchecked, may stop the behaviour you're describing.