Can you just as easily pick a quorum of folks? It seems to me that no matter what, you're going to have to choose people you know and be accused of nepotism because those are the people you can actually assess, and in the case of children, hopefully raise/influence to be on the same page as you.
You could always donate it to the US government, but then it'll be used to go start some wars, so that won't work. You could put it in some weird trust where random people can democratically decide what to do with it, but all you have to do is look at the government to see how good of decisions that leads to. So truly what's the alternative?