Apart from the obvious reason why it can’t work (jealousy), one problem is that it’s not good for society at large. These groups are probably low fertility for one, and they take partners away from others.
Not to mention that every “polyamorous” society eventually settles into polygamy—-and that’s poison. Expect a reckoning when that happens.