Sure you do.

As long as you can continue to pay the mortgage each one, nobody is going to come along and kick you out of the house.

The "problem" is that you can't sell your house for a profit to exchange it for an even more expensive house. Hence, the rest of us are on the hook to ensure that your house can continue to appreciate in price.