Incidentally, despite the oft quoted, "Bill Gates would be a broader guy if he had dropped acid once", Bill Gates basically did admit to taking LSD in a 1994 interview:
As with most drugs, those who don't wear the uniform of the subculture associated the drug (or at least strongly show the personality traits their users like to attribute to the drug) are assumed to never have done them.