That's because the city is overly tolerant to blatantly harmful activities, public indecency, and antisocial behavior, not because of drugs.
If laws regarding public drug use, loitering, etc. were actually enforced in a meaningful way, I think we'd see some actual improvement.