How do you make money on the debt? Rent it out?
This ignores the rates-price and inflation-rates nexuses. When inflation goes up, ceteris paribus, rates rise. When rates rise, all else held equal, the price of leveraged assets like real estate falls.
TL; DR this trade is an arbitrage only if you've perfectly hedged the price of your underlying asset, the house.