I’ve worked remote and managed remote teams for a long time. I would say it is indeed more complicated.
You may not struggle with remote work and may do fine interacting remotely, but that’s not true for a lot of people. It’s very common to hire good engineers into remote positions and discover that they can’t focus at home, they misinterpret digital communications, or that they just wanted a remote job because they read somewhere that they could work 2 hours per day and nobody would be able to tell.
The obvious retort is that you just need to hire “right”, but that’s not an easy thing to do.