Another point is that in most countries outside of the US, panhandlers are either "working for themselves" and make decent money, perhaps better than at a low-end job while having proper living arrangements, etc (and thus "rob" the true poor from the donation). It can also be worse, with situations where panhandlers are actually curated by an organizer who pays them a salary and takes a profit. The latter schemes are also mixed up in exploitation.
Now that I type it all out, I am realizing that buying a meal also prevents the second scenario too. Good stuff.