I think that most YIMBYs are arguing the opposite: That if I buy a piece of land, and I want to build a duplex in it, all the way to the property line, I should be able to do it. As it is, zoning and the approval processes make all kinds of viable projects impossible to do, by the property owners.
If I wanted to turn my single family house into a duplex, or just tear it down and build bigger, to far closer to the property line, I'd be completely unable to do so, because the zone is R1, the minimum offset to the edge of the property is enough to part 2 F-150s lined front to back. The maximum legal usable square footage, across all levels, of the house must not exceed 40% of the square footage of the lot. Most of my property must, by regulation, be lawn, and the taller I build, the more lawn I need. There's houses with this zoning structure right next door to supermarkets.
So how is asking to be allowed to redevelop your own lot being against private property ownership? If land is so plentiful nobody wants to build taller, the land will remain very low density. But the idea of having a lot that, if razed, would be worth a million dollars, but where building a duplex is illegal is not, in any way, going against private ownership.