However there are those people that comes to the office to talk all day, and honestly, for everyone else's productivity, it's better they work from home.
I don't want to be unfriendly, but I'm at work to get shit done because I'm getting paid. If someone wants to talk hobbies, we can do that another time.
I've had this happen in the past with managers doing reviews. While in these cases I've usually enjoyed the conversation and been at least as guilty as them as derailing the focus, it's still time where I could be doing work instead of discussing common interests/experiences with them. It's not like we're ever going to hang out outside of work so us discussing local shows we both were at two decades ago, or our morel hunting success this year, or what variety of potatoes we're planting, is just taking us both away from work (sure, sometime that is needed just to get in a different headspace, but the shareholders probably don't care about that).