They are not adding to scarcity because they are renting it out. The unit remains available on the market to house people. 1 house = 1 house.

If they were just sitting on it, that would be reducing available housing.