Hajj visas are very restrictive. You aren't allowed to go anywhere except Mecca and Medina, and you're only allowed to stay for the length of hajj plus a few days extra for travel. And many of the people who go to hajj have spent their life's savings just to get there. So not a lot of foreign money is flowing, at least not compared to those other places.