Gambling your entire net worth on a single hyper-local investment is not a good idea.
Markets also go downhill. If you really went all out with paying for it, you also need to hope that your employment will remain stable. People who are very comfortable with their job and predict no downsides are often the ones getting bitten when the market changes, as it always does.