We get security alerts when we set a channel to public. We also have 1 day retention for private chats. (Teams, not Slack, but same idea)