That’s life moving about outside your threshold, embrace it a bit. When it’s too much, put on white noise, if that doesn’t work move into noise cancelling headphones. My family bought me a set for Father’s Day 10 years ago or so and I haven’t looked back. Good for phone calls as well.
I wish you all the best in your WFH journey. I have been doing it since 2006, it’s a “what works for you” kind of problem.