From 1968 to 2004 the average home value in the US had an average 6.4% YoY growth[1]. An index fund will grow your money much faster than that, all without saddling yourself with debt or exposing you to the risks of the housing market, both as a whole and in your area.

You were lucky to buy your house at the bottom of the 2008 housing crash, it doesn't mean that houses are a good investment today.

[1] https://www.investopedia.com/articles/mortages-real-estate/1...