Personally I think most substances in moderate quantities taken only occasionally are no big deal. Yes there is probably some minute health impact visible in long term longitudinal studies but it's probably dwarfed by other lifestyle factors. I would rather be someone who exercises regularly, eats a healthy diet and uses MDMA or cocaine a few times a year than a sedentary obese teetolar who's never touched drugs.