You are improperly accounting for risk. People don't own a diversified portfolio of houses, they typical own one house. The "if you hold it long enough" is to some extent disqualifying. Many people never see any real return over multiple decades.
Where I live rents won't cover the interest payment on a new mortgage. The return on renting is insanely good here in addition to the increased optionality and reduced risk. I've owned many homes, I'm just not emotionally attached to the idea of owning one nor deluded about the rate of return.