They probably just see that the Fed going to raise rates and realize that there are going to be less mortgages handed out which means less customers.
I doubt the market will be affected too much if rates are increased yet stay below 4%. Many houses in my local market are selling in under a day; a small increase in mortgage rates won't tamper that demand to any great degree.