It needs enough diversity of users to be resilient against a 51% attack. If you don't have that, the value is 0. (You lose the benefit of the distributed ledger and may as well be relying on a central party's database at that point.)
So what you actually need is a party who controls most of the validation and is willing to go against their own economic self interests in order to cause damage, that's a much bigger ask.