That is a really important point, but I think that it still doesn't counter the argument about the career downsides of being remote when you don't work for a 100% remote organization.

My company is pretty flexible but as a scientist/engineer I still have some duties where being in the lab is necessary. I'll probably increase my remote work for now but likely not move further away. I enjoy my bike commute in the East Bay.