Working from the office ONLY works when everyone else is working from home and I'm the only one there.

At which point I might as well work from home, and sell the extraneous office space.