You're not alone. After years of no issues and enjoying the intoxication, I had a really bad trip that caused an "anxiety attack" specifically existential anxiety. While intoxicated I would rarely but sometimes feel paranoid, however, this was my first ever time experiencing anxiety at this scale, and it persisted while I was sober.

It was (and sometimes is) really bad!!

It took 4+ months of therapy to get back to "manageable", and over 2 years later I felt back to normal and in control. I've now stopped any intoxicants (alcohol included) almost entirely. I sometimes will participate with a good group of friends, but I'm far more cautious of any intoxicant.