Yes, it's not about reducing communication, it's about keeping the number communication channels and coordination manageable.
The "two-pizza team" is like a squad/section in military organization. It's the sweet spot of having enough people to get things but not too many people so that communication and coordination starts to be a problem.