Rules around how the area should look, should be decided by people that live there. There are many better examples where it makes a lot of sense for the locals to be strict about rules about what can be erected.
I used to live near the Village of Corfe Castle. Generally the argument is that the place would lose its character and it won't be the same place anymore if it didn't keep its distinctive look.
https://corfecastle.co.uk/the-village/
If you would just start building places that don't fit in with the rest of the village. The village wouldn't have it character and thus it wouldn't have its tourism in the Summer as a result.
There countless towns and village with a bunch of heritage that literally goes back maybe a millennia and the argument that we should throw this away to build a load of crap houses (new houses BTW are awful, I've looked at many in the last few years) is completely asinine.