This is definitely untrue for present-day Twitch. When you're in a chat room, you're in the chat room with everyone.