Taking photos of homeless people is generally seen an unacceptable amongst street photographers. I think maybe you're focusing on a couple specific people?
Street photography is for hacks. I've known a lot of them, they're never good people.
It seems you've had some bad experiences, that's a shame. But that's a hell of a broad brush you're painting with there, when there's so much good street out there telling beautiful stories from people we would never have heard from.