I suspect the remote aspect is the biggest thing slowing you down. I go in once a month, which is practically a remote job, but those who moved during the pandemic and wouldn't fly in and take a hotel on their expense once a month had to leave
There are 1000 different flavors of mixed home-office working right now, but not that much fully remote