Don't know where you live and work, but that's not the case for me. In most buildings I've worked in, aircon/heating switches off around 6pm. And I certainly don't leave my home heated while not in it.
Of everything wrong with modern society, the inefficiency of having separate home and office buildings ranks pretty low imho.
Another way to look at this inefficiency is to imagine how much cheaper (and, on average, bigger for an individual) housing could be if we had no need for offices. The inability for the young people to buy their own place seems to be universal in (at least most of) developed world (Australia, Canada, USA, UK, Ireland, EU, NZ, Japan, urban China, ...).
The cultural impacts of that change are pretty interesting as well, though that sounds like a thesis topic to me.
We even fly in the folks who are truly remote - they don't live in the same metro area or even the same state. It's still a lot cheaper and more energy efficient than commercial real estate.
...which caused huge issues with moisture and air quality. The buildings were designed to have forced air circulation 24/7. Changing it to 12/5 just messed up everything.
It would be a better benefit to society to turn most of these office buildings into apartments.
Eventually the heat will get in, and then you need to run thr system to get it back down, which could take hours.