"We hire only the best, wherever they are" is just a longer way of saying "We hire only the best" which is just a longer way of saying nothing. Every business has been chanting this forever, along with some variation of "customer-focused", from largest investment banks to smallest not-for-profits. This noise is safe to ignore as rhetoric with no real signal of what the company actually believes.
There is only one reason to run a remote team: lower cost. Every other advantage is just a longer way of saying "save $". "Get higher skills" or "Faster go-to-market"? Triple the pay, and you'll have even stronger/faster people locally. "Workers want freedom to schedule their work"? That's an argument for more flexibility in office hours, not for more timezones. "People focus without background noise" is so true that you should give them private offices. "Reduced commute" is a valid reason to encourage work-from-home twice a week, not to inject thousands of miles between key collaborators. To cut through other examples, ask yourself this: "If I had $100M to spare, would I start with X or Y?". I don't know anyone who built a business that would say "No doubt, remote-first".
However, this lower cost always comes at the expense of -
1. Innovation: The myth of an isolated genius has been discredited too many times to count: innovation is a byproduct of social and intellectual interactions between unrelated ideas/people/experiments, working in close proximity. See the book "Innovators" for endless examples how this shaped the world of tech. Startup magic happens when a salesperson overhears your call with the client, or when an engineer is tired of listening to customer support people whining, or when you look over the shoulder of how your newly minted PM actually works. Oh the horrors, oh the joys. Serendipity is virtually absent in remote team even within the same discipline, and unimaginable across.
2. Productivity: The most high-bandwidth communication is when you're thinking inside your head (~5s). If you have to explain the idea to someone else, you can have a conversation and that will be 10x slower (~1m). If you have to type it out, it will be 10x slower (~10m). If you have to wait for them to read and ask a question later, that will be another 10x slower (~1 hr). When most discussions must happen in writing and asynchronously, then your internal feedback loop is 10-100x slower than the competing team working together. Pretty soon it will take 1-2 days of roundtrip chats to decide something that you could have resolved while walking back from lunch. If "Your rate of change" > "Market rate of change", the startup might survive. If that arrow changes direction, no amount of documentation or stigma-busting-hierarchy will save you.
3. Culture: First 10-20 people will define the ethos and behavior of your company forever. Creating a shared vision and excitement is a herculean task even for the most empathetic leaders, to say nothing of us mere mortals. This culture will make or break the business when the going inevitably gets rough. Just imagine yourself saying out-loud "and for our team-building this week we'll be doing a Zoom conference call!" and see what you think are your odds of creating the culture you want. Physical distance breaks the strongest of bonds: besties drift apart, kids forget parents, and lovers become strangers. Those who survive must summon inordinate energy and emotional effort after being cordial all day.
If Innovation, Productivity, and Culture are not important for your company, building remote teams might be for you. I am not being facetious - many service businesses do not care about any of that, especially if they charge hourly. Examples include IT support, process administration, WordPress development, SEO, accounting, data entry, etc. Incidentally, these are the main cases where we observe remote teams being remotely competitive in the market. In other cases, companies have to start spending inordinate amounts on extra managers, coordinators, culture-building folks, on-site travels, and other overheads to try to reduce the impact of not seeing your colleagues smile at a lame dad joke.
If you are entering the startup game - with a small team, searching for a product/market place, then a way to scale up - then think about what it will take to navigate that path. Alternatively, look at those around you who have done this already. There are perhaps fewer than ten kinda-well-known companies that started as remote-first (e.g. Gitlab/Figma/Buffers of the world), and zero of them matter. All other creators you respect and try to emulate (from startups like Zoom, to VCs like A16Z, to thought leaders etc) have experimented greatly and converged on the same conclusion: to create something amazing, you must work predominately in-person. It doesn't matter what they preach, it only matters what they practice to get their results.
That the startup graveyard is filled with teams who worked only in-person tells us nothing. That's the natural order of business; it's brutal. That among thousands of successes from the last 20 years, approximately zero of them started as remote-first, now that tells us everything. In the evolutionary race among millions of startup organisms, one specific survival strategy is so overwhelmingly dominant as to be almost a pre-requisite of success.
P.S. "But Stripe is a mega-success, and they are going remote!". No - Stripe created something amazing first (in-person), became a $20B behemoth, ran endless other HR experiments, and now decided to trial remote-first work for 5% of their workforce - backed by endless corporate support, legal/financial expertise, and deep pockets. Today they are closer to Bank of America than a startup, who also can run such experiments for the lulz.