Exactly. At birth we are basically no different from someone born 100, 500, 1000 years ago. People in the past we not stupid. In fact, the giants who's shoulders we stand on now are from the past.
This isn't to say the camel doesn't have two humps. I tried pretty hard in college to learn German, but by then it was too late. Kids can learn languages without even trying because they're wired to learn languages. Waiting till college to learn German effectively doomed me to failure.
A similar thing might be happening with programming. Some people don't start thinking about programming until pretty late, sometimes as late as college or beyond. Perhaps some of the people who "just can't get it" could have had a chance if they started sooner.
This would imply that there is no fix at the college level; the solution is to start introducing programming/logic earlier.