Depends on the jurisdiction but they are often within their rights to call the loan especially if it goes into negative equity.