Bullies are everywhere. One runs X. You deal with them.
I never saw any drug dealers or gangs and the rest of what you’re describing sounds like what I’d expect as a normal part of growing up.
One of our many societal shortcomings (or outright failures) is that we treat poverty as a moral failing, not with any sort of kindness, interest in understanding the root cause(s) or meaningful attempts to address the issue.