Without taking away from the reality of housing costs, the long-term chart [1, chart is a year old but looking for trends] suggests other explanations. In particular, the average of first-time buyers was 35, up from 30 as recently as 2010. That's a bad trend.

The overall average appears to be driven by people who have bought homes before. Anecdotally, the Boomers I know bought houses well into retirement where their parents typically made their last home purchase in their 30s. I am less concerned about housing turnover among older people.

1 - https://www.axios.com/2023/11/20/american-housing-market-old...