I've just found that to be the opposite. When someone is out of office their work is really easy to see. You can just look at their contributions. In fact, it's kind of on them to go out of their way to show the work because a lot of the natural "ah yeah I just got that done, that was tough" conversations won't happen.

The people in the office have a farrrr easier time relying on non-work to look good. They can have conversations, build relationships, etc very naturally. They look like they're working so it's just easier for them not to. I can sit at my desk all day reading HN and I look like I'm working, people will assume I must be. If I'm sitting at home all day reading HN, not so much, I'd better have something to show that I got something done.