Well, sure, there are philosophical problems with having to work at all for a living -- but work is required by nature. If one sits and does nothing, one starves to death.

There's nothing in the natural order that says I must starve if I don't report to a particular building every day and sit at a particular desk when the tools for me to perform the same labor at a place of my own choosing exist. Forcing me to do so in order to maintain an employment contract is coercion, plain and simple, and the sooner society destroys that norm the better.