They did build the Empire state building with a mooring mast and a a lounge / ticket area and a way for the passengers to get on the plane. But it was purely speculative, and though they took publicity photos, they never used it(remember: there were only a handful of commercial airships).

There used to be a commercial heliport on top of the Pan Am Building over Grand Central Station. The first helicopter crash that sent chunks of metal flying 600 feet down to streets with huge amounts of foot traffic permanently closed it. I'm sure something similar would have happened had the Empire State Building 'port' actually been used.