"""By default, your app is set to keep running in the notifications area even when the window is closed. Choosing not to leave the app running will remove the Slack icon and badges from your notifications area."""
When you Command-Q Slack, it should close completely (which afaik it does).
To quit it, choose that from it's menu or use the cmnd-q shortcut IIRC.