I'm at a Fortune 500 that cut back nearly all of its remote work. I prefer remote work, and I thrive at it. However, it can't be denied that there are some drawbacks. A few: A) Training new hires, B) bonding (while those in-office chats often detract from raw work-time, they also contribute to relationships. Positive relationships are a worthwhile lubricant when make requests of others), C) increased friction for chatting, which is often a net positive, but does have the potential to block progress that is born from impromptu chats.
Yes, you can try to work around these and other challenges, but working around long-evolved brain firmware that, for many cases of interaction, favors in-person communication, is tough. Of course many people prefer to stay at home, as do I, but there is a huge increase in the level of connection I feel when I go back to the HQ and hang out with everyone (a handful of times each year).