It is my opinion that the extra inconvenience that in-person folks have to do it dial into a meeting and use a virtual whiteboard is worth it to allow remote folks to fully participate. But ultimately it comes down to how strongly a company supports a remote culture. I’ve worked for 100% distributed companies, and I’ve also worked for places where remote was an afterthought. I imagine at some companies it’s harder to get promoted if someone doesn’t physically see you in all 3 dimensions every day.
As a remote employee I will always try to gravitate towards companies that accommodate me best, but I’m not opposed to the idea that some companies want to be in-person and don’t want to deal with remote. I just chose not to work for those companies.