I know that many share your views.
If you have no home, it's hard to get a job. But it's hard to get a home if you have no income. So people end up on the street. They then face a choice of a street in a town, near to shops and services; or sleeping in a ditch in the boonies. I've slept in a ditch in the boonies, and I can't recommend it. And Social Services don't patrol ditches in the boonies.
A homeless person can disappear in a big city; it's easier for services to find them and help them in smaller towns. So if I was in a scrape, I'd head out of the city, to a smaller town.
With respect to forcibly taken taxes: they're taken "forcibly" because it's the law that you have to pay taxes. They don't usually come around with guns, to separate you from your belongings. We have a social contract, where I live, that we get free education and health-care and stuff, in exchange for paying taxes.
I was a fairly high earner, until I retired. I've never objected to paying taxes. I do object, very strongly, to corrupt politicians taking the piss with taxpayers' money; but in fact it's a small proportion of tax revenues that get stolen like that (here).
Frankly, I'm OK with the taxpayer paying up so that we don't have an underclass of people who are ill, psychologically troubled, homeless or intellectually challenged, and who are compelled to live under hedges. It could be me that's down on their luck, some day. If I were in that situation, there's a pretty good chance that I'd be resorting to substance abuse.
You're entitled to your views; but it seems pretty harsh to me, to simply declare that those people need to solve their own problems, and leave the taxpayer alone.
Is it perhaps also your view that the only legitimate use for taxpayers funds is to send armies to foreign countries? I'm not in favour of that. And I'm not in favour of taxpayer subsidies for diesel-oil for motor cars. I cough up, because the deal is that I either put up with the way collective taxpayer resources are spent (after making my point at the ballot box), or I leave the country.
As it happens, there's no other place I'd prefer to live. So here I'm is, very comfortable thank you, and I try to be kind to people who have to live on the street. Nobody would choose that if they had an alternative.