I mean in my case, I never even considered drugs until I started smoking weed in college. So it was definitely a gateway drug for me. At first glance, weed has little to no noticeable downsides. This made me think that the other drugs must be the same way. It led me into a drug abuse phase of my life that I still struggle with. Prior to that, I barely did drugs at all and had no real inclination to do so.
I think part of it is the crowd you end up in when you smoke weed. Unsurprisingly, drug use lends itself to putting you in situations with other drug users. These users often completely ignore, leave out, or outright lie about the downsides of these drugs, from chronic weed use to LSD.