I've been dirt poor for years. I'm a freelance writer by trade. I like writing. I've always wanted to be a writer. I hate being poor, of course.
I've been told for years to "go get a real job." I'm medically handicapped. For that and other reasons I can't readily "just go get a real job."
The fact that you hate the working conditions and pay doesn't mean you inherently hate the work. There are people who garden as a relaxing and enjoyable hobby.
The assumption that all poorly paid people hate their work and all well paid people enjoy their work sounds like classist prejudice to me.
I knew someone (a programmer, in fact) who made good money, got fed up with the job and they we're told by someone close to them "You can't just up and quit. A job at Home Depot wouldn't even cover your car payment."
I've also seen stuff on the internet from people who are miserable, desperately want to change jobs and feel stuck because they make good money and can't readily walk away from their good income. They have family to support or college loans to pay or whatever.
What you find is that even people who are overall happy will bitch about their job or whatever, if only because it's a socially acceptable bonding ritual. Bragging to the miserable people around you about how everything in your life works wonderfully well all the time is a good way to get everyone to hate you.
There are real quality of life issues for low paid work, farm labor work, etc. But there are farm laborers who live in Mexico and work the fields in the US because they like living in Mexico, they have no desire to move to America and it pays ten times better than jobs in their town.
Not all of these people feel exploited or victimized. Exploitation isn't a good thing in any job, but it's not somehow the inherently part of doing physical labor and inherently not part of the picture for jobs with better public perception.