Without data, any opinion of this subject is bound to be based entirely on society's collective opinion or individual anecdotes. Within those limits, I'd argue that "people that enjoy that shit" are actually more reliable.
I believe the partition made by the the post you're replying to gets pretty close to my anecdotal reality. I'm somewhat convinced that heroin/crack/meth are addictive and that alone will always scare me off. Whereas LSD/mushrooms/ecstasy have almost no potential for addiction.
And, yes, having experienced them tends to make you run around telling people that it's part of the human experience – much like I'd tell people that they'd miss something essential if they never got slightly drunk on white wine watching the sunset on a beach.