Don't wait on your company to make a remote work plan once they've got you all back in the office. Start looking around now while they don't have a monopoly on your time. That doesn't necessarily mean taking interviews during work hours -- my previous job was 10-6 eastern, and east coast companies would happily interview me at 9, while west coast ones interviewed me at 7. Once your current company has you back in the office, they have a much stronger grasp on you, and they know it. That's why they want everyone back in the office before they talk about remote work.
But if you're not going to a company that is itself 100% remote, I'd still be wary about being the stranger that they only see online. I went with a job where I was only an hour away from the office but could still work remotely, and plan to be there once every couple months, so I still get some face time.