I completely disagree with this. I have a friend who recently turned down a job that would have been a significant pay increase because he didn't like the sound of the working conditions (which would have also included relocation to a new place).
Many of the times that I recall when friends have left their jobs, the reason they left is not necessarily because they weren't being paid enough, but because they became tired of their job, or something changed at their employer that made working there less tolerable.