This question depends heavily on whether the whole company is remote or not.

If it's not a "remote first" company, then you need to be prepared to be left out of a lot of conversations. Your opportunity to grow beyond engineering is extremely limited. You'll likely never be promoted past engineer. IMO this is the biggest issue you have to face as a remote engineer, the rest is in the noise.

If it IS a "remote first" company, then all the other issues presented are worth focussing on.