What's stopping a bank of fish, or a whale from eating the whole thing?
This article has a picture of a sea turtle taking a nice chomp out of a smaller one. Maybe nothing that eats them ever feels like eating the whole the colony. It would seem it's pretty tough to tear it.