It can matter for future job prospects. You being at least somewhat physically available to make in-person appearances at least sometimes without it being a big deal is appealing to many employers.
And this comes from someone who is patently not a job hopper.
If you have a job, it less important. If you want to change jobs it still valuable. More and more employers want folks near by.