Well, unless it's alcohol or tobacco. Or in the Muslim world just unless it's tobacco. Or Khatt in Somalia. etc.
It's a mess and entirely determined by cultural history. I'm not aware of any culture that comprehensively bans all drugs, they just dodge the issue by weaseling the definition of what constitutes a drug.