This way, you can keep it open and dip into whatever you need to but you'll not be swamped with millions of notifications.
I'd also go through all channels etc and mute or leave channels you're not actually required in any more.
I tried leaving channels but I get invited back whenever people tag my team, so I gave up and muted all of them (but still get the notification counter, which makes muting useless for me).
EDIT: Whenever someone tags my team, the little Slack icon on the tray bar goes red... and I don't know if that's a direct message (usually important) or someone tagging my team just "fyi". I have to check it always.