I think that in the long run, our biggest bottleneck is technological innovation, and not any static resource constraints. The return on new scientific breakthroughs is huge, and even if only 1% of the population can come up with and develop such ideas, the return will often be enough to increase the quality of life of the other 99% by orders of magnitude.