Yep. Goes with the territory. If you assume the role of gatekeeper, everyone, even people who don't like you acting as gatekeeper, can legitimately criticize you for the decisions you make about what does and doesn't go through the gate.