Rather the closed system includes both the craft and the ejected mass.
If you include the ejected mass, then momentum is conserved in that system. The ejected mass goes one way, the rocket goes the other. The momentum of the rocket is equal and opposite to the momentum of the ejected fuel.