The XS is 7.7mm thick, the SE 7.6mm. It's not a relevant question.
Were the new generation of phones thinner than the jack I'd have to concede you may have a point, but that is not what we're getting.
If the question becomes "would you like 0.2% more battery or a headphone jack?" I doubt many would vote to remove.