And it falls down as soon as you want to enforce any other rules, like say, property rights.
If I reach to take your property and you slap my hand away, you have broken the NAP as you define it. Or you let me take it, but then expect the police or security company to punish me, they are breaking the NAP.
You are right. For this desirable, two universal consents are needed: 1. NAP 2. Land Registry (eg blockchain based).
I claim that there will be 99%+ consent among inhabitants of a perticular region, which is good enough.
This have to be mentioned that no society (ancapism or socialism) can function without some minimum level of cooperation from all which is safe assumption because we are after all social animals. When this characterstic is not found, people migrate as they have been doing since ages.