Uh, in the housing that they build? The amount of housing we can build with cheap immigrant labor is so much more than what we can do without them.
Housing gets more expensive when immigrants are pushed out, because the cost to build rises more than the reduced demand reduces prices.