You might need to prune and/or curate your slack channels better. For major projects/initiatives we use a new ephemeral slack channel for the duration of the project. All chat comms about the project are stored there. The project roadmap is kept in google docs with tickets in jira.

We have 12 teams and 150 people and prob 50+ channels.