The problem is that legally, zoning already is an "opt-in" protection of property rights.
There is no taking, because the restriction is already voluntary, and in consideration of mutual benefit of like-zoned neighboring property being similarly restricted.
It's obviously evolved into something else, especially as seen by the public, but that philosophy remains the legal foundation for it.
Even if zoning changes require approval, only the property owner can determine the original zone, and only he can request changes.
Buying zoned property, knowing the extant restrictions, is essentially opting-in "voluntarily". It's the same reasoning for why "grandfather" exemptions exist (no original consent).
What this federal argument is actually for, possibly without realizing it, is a method/mechanism for contractural/ municipal/ jurisdictional succession and/or nullification.
Those are the terms that need to be thought of in context of this discussion.