Pre-Covid, I was a VP Eng at a startup (total eng team of ~40), I had so many "discussions" with the CEO about who was in the office at what time. The team was people from all stages of life and backgrounds. My QA lead got to the office at 6am and left at 3pm to avoid traffic. Another Eng was a single mom, and was in the office from 9:30am to 3:30pm, and then got back online for a bit after 8pm. Etc. Etc.
Time and again, I'd simply reply with metrics to demonstrate how the team was hitting product & roadmap goals while improving quality. One that really made the point was the Github commit heat map, since there were commits ranging from 6am to 1am every day, with occasional outliers.
On the plus side, I felt particularly well prepared for the WFH / hybrid era, since I was already in the habit of looking at results & outcomes (and setting expectations based on these) vs. hours of butts in chairs.