There are arguments to be made on both sides, this isn't a black and white issue. The history of preservation is fascinating. Especially after Penn Station's demolition, NYC went through a big debate on other landmarks like Grand Central: https://www.smithsonianmag.com/history/preservation-battle-g....
> While few doubted the significance of Grand Central, the terminal’s owners took issue with the law itself—how, they wondered, could it constitute anything other than an unreasonable violation of their rights as property owners? Preservationists like Onassis, working with groups like the Municipal Art Society, continued to insist that saving Grand Central and buildings like it wasn’t a mere real estate matter, but an issue of public good. On June 26, 1978, the United States Supreme Court agreed with them in Penn Central Transportation Co. vs. New York City, not just in regards to Grand Central but in the spirit of the Landmarks law itself...
In retrospect I don't think you could find a New Yorker who regrets that Grand Central was saved after seeing what Penn Station became.