I couldn't second this statement more. I've been on both. Remote with a colocated team is a special kind of hell. You are out of the loop on so much and the isolation is overwhelming.
Hell? I'm out of the loop a bit for sure, but in two hours when we do our sprint planning.. their backdrop is a tiny windowless office while mine overlooks the pacific ocean.