But it does depend on the nature of the panhandling, doesn't it? Passive panhandling is one thing, and aggressive panhandling is something else, right?
The point is that people will accept some level of anti-social behavior, however they define that, and above that level they do not. No amount of bluster or "why I just never" or incredulity doesn't change that. If you want walkable cities with good public transit you make it attractive and hospitable to a wide majority of people.
Or don't, no skin off my nose, but acting shocked that there are people who think and react differently than you do is silly IMO.