Sorry, I was on mobile and found the first link. But I think the stats aren't as bad as you think. For any given year, you will have some inventory disappear completely. There is also new inventory being built. So, the average house size of all houses is also increasing. Not as much as the average new house size, but definitely increasing. Most people don't live in old houses from the 60s.

I would actually ignore the average household size. We already know that that that decreasing over time.

Note that I didn't intend my comment to be a personal attack on you. I'm merely trying to point out this trend. Apologies if I came off that way. But your case also highlights another fact that was rare back in the day -- using your house as an office is increasingly becoming viable or necessary for those doing remote work.