I'm not exactly sure why this is controversial at all. And I think most of us know and believe this to be fact.
I am 5'10" tall, born and raised in Western society. I am taller than my most of my ancestors, but only marginally taller than my father. He grew up in India, but his family was non-vegetarian in a village of pure vegetarians.
We might have been able to be a little taller if we understood nutrition a bit better, but it's probably within an inch or so. Our height is limited by genetics, not by environment.
It stands to reason that if physical attributes like height are subject to genetic determinism, aspects of our brain & mind should be too. Now, comparing brains to height is very reductive, since the brain is infinitely more complex. But there's a probably a pretty good reason why my father and I have very good memories, and are fairly intelligent people. But we're also not superstar athletes, or great artists. Genetics and environment have optimized our brains in a certain way. And I'm already seeing the same traits in my 1 year old son.
But isn't that the beauty of genetic determinism? Isn't that the beauty of all of us having vastly different life experiences? I don't lament the fact that I don't have the genetics of Usain Bolt, but I can admire and appreciate his prowess. Similarly, I don't lament the fact that I'm not a great creative like Picasso or Mozart. Something about their genetics and environment allowed them to achieve greatness in areas I am not capable of. And that's fantastic, because our society is enriched because of this diversity.
I think a society that celebrates the individual, gives them the resources and environment to achieve whatever they're capable of, and thus, reach the limits of their own genetics is one I'd like to live in. Realistically, most of us are not even close to be limited by our genetics, but man, how awesome would it be if we were?