It stems from the Protestant Work Ethic and religion more generally. One of the biggest sticking points, if not the single biggest, between rational humanism and religious viewpoints is the place of suffering in the world. Rational humanists view suffering as negative, and something to be avoided, alleviated, and prevented, hopefully to be eliminated. The religious view suffering as purposeful, as bearing meaning, and of a potential way others might be driven, out of stark desperation, into the arms of their religion.
The Protestant Work Ethic measures a persons virtue by how much suffering they endure in their work. The more poorly paid the work is, and the greater the suffering it causes, the more moral the worker. Desire for respite is vice. Desire for pay based on the value of the work being done is greed. Desire itself is far more immoral than any suffering inflicted, and something for which forgiveness should be sought.