People also maliciously ignore the obvious fact that living in a society which is lenient towards burglary automatically attracts opportunists, who were not actually poor in the first place.
Personally I think it's because people have these standard narratives floating around in their mind, and pattern-match them reflexively even when it doesn't make sense.