If most people didn't have to work to survive, they wouldn't know what to do with the time. An observation about slavery is that you've traded in the burden of responsibility that liberty introduces for the comfort of not having to worry about what to do with yourself
It's easier to just go do what you're told than it is to determine what must be done. Most people actually prefer that way of living. Left to themselves, they'd either become paralyzed with indecision, or they'd piss their lives away indulging their appetites and possibly commit suicide.