Do you commute to an office every day, sit at a desk in a 4 person shared cubicle, have monthly "performance reviews" by someone unqualified to manage your subject area, have to deal with 3 children's weekly scheduled school-caused sickness, own an old car and only 1 so it is out of service when it needs repair?
I worked from home for years ... scratch that, I "lived at work" while at home for years. If you believe that getting your work done on time only during 9-5 then you've never had to deal with after-hours emails demanding results by the next morning.
Take a job that requires a 1-hour "10 minute standup" every morning at 8:30am so it "doesn't impact the work day". Take a job that needs at least a week to complete with no external progress (e.g. programming) and listen to the constant requirement for "progress updates". Note how there is a built-in assumption that because you're home you're slacking.
Fight through heavy snow or rain, struggle to find a parking space, find out there is no coffee in the break room, that only 1 of 3 toilets are working, that the internet connection is down, and your other 3 cube-mates are all loudly sick of something "going around in the office".
Sure. Go ahead. Assume the worst of your employees. Like children, make sure you can see them at all times.