There would absolutely still be mortgage lenders without artificially low federal funds.

I manage a fund in Canada that does exactly that. We have a pool of investors, and lend out on mortgages only. Primarily in markets larger institutions won’t touch.