I can imagine the argument when X is something that only negative affects the 'defector' (eg: "everyone should wear a helmet but the government shouldnt make you wear a motorcycle helmet") but what's the rationale when the reason that everyone should do X the social good at no costs, rather than personal good?