It’s highly unlikely that you’ve never taken psychoactive substances—caffeine, for example, is found naturally in enough foods that it’s hard to avoid. Many spices produce psychoactive effects—e.g. vanilla, pepper, cinnamon, ginger, saffron, etc. I suspect it’s not your opinion that these are all bad as well.
Your kids at some point will be exposed to some of these things, and if “drugs are bad” is what you’re teaching them then they will understand, as we do, that your opinion on this subject really isn’t helpful.