If elevators are the limiting factor, I wonder how much of an engineering challenge it would be to have multiple elevator cars in a shift. I'm picturing a system where each floor has some number of elevator car parking spots off of the main shafts, and elevator cars move backward then horizontally first to get to the main shaft to travel vertically.
The other limiting factor I could see though is limits on parking, public transportation and utilities.