The trouble many people I've spoken to have with charities donating to "the poorest people in the world" is that it tends to create a dependency cycle that is hard to break out of and often helps prop up corrupt governments. It's seen as a low-resolution, hand-wavy, throw-money-at-the-problem solution that actually perpetuates the problem. Nobody seems to want to discuss the root causes of these impoverished peoples - typically generations of incompetent and corrupt governments (or higher-than-average levels of incompetence and corruption if you prefer) that are shielded from accountability because there's always someone to bail them out from the worst consequences of their actions.