The major difference has been in the dead time around work. Time spent commuting, lunch breaks, coffee breaks, etc. When working in an office, nothing much is achieved during those (maybe some socialising or reading), and work takes them out of my time rather than their time.
Working remotely gives that dead time back to me, allowing me to spend it on things I consider more valuable (e.g. playing a musical instrument, doing some DIY around the house, gardening, putting on washing, etc.).
It's that which I feel has given me a better quality of life than the act of not working in an office. If an employer is paying me, I don't object to doing that work where they request. What I do object to is the extra hours that takes out of my life that they aren't paying me for (typically commuting).