Basically, all the arguments I've seen against Abundance tend either towards the ideological, or irrelevant. I tend to see very little empirical arguments.
Housing, though, could definitely use a better market with less constraints like zoning.
That said, the Abundance argument for building more housing is that in many local housing markets, the pendulum has swung too far the other way in ways that are well-meaning but ultimately counterproductive. This very article makes the case that oligopolistic economic power is not the reason for unaffordable housing.
https://bendyimby.com/2024/04/16/the-hearing-and-the-housing...