These calculations ignore that most homes are eligible for extreme amounts of highly protected leverage. Sure, you can trade on margin on the stock market, but you are subject to margin calls, which is not the case with a home.
So multiple that 16x by the typical 4x-5x leveraging, and homes turn out to be really great. And since the transaction fees and the non-existence of index funds in the 1970s made it harder to invest in the stock market at a small scale, and homes were a much better investment.
Add on to that that everybody needs a place to live, and your home acting as an investment vehicle with equivalent performance to the US stock market, and people from the 1970s have had had an amazing deal that younger people have not had access to.