I think that is correct. While most people buy a house -- they budget to a payment. The last time we moved our realtor even tried to engage us in this direction. It is very similar to the way car dealers explicitly work -- "What do you want to spend a month?"
If interest rates rise dramatically, average home price will necessarily fall.