It's not a mistake to tie it to race. Race, or some hidden variable correlated to it, is highly predictive even after accounting for income and similar things.
https://randomcriticalanalysis.wordpress.com/2015/05/16/on-c... http://ftp.iza.org/dp8733.pdf http://www.mindingthecampus.org/2010/09/the_underperformance...
Further, the effect size is large - far larger than anything you could hope to accomplish with a teacher.
Supposing that the cause is genetic, I'm not sure how it's different if the genetic influences were caused by slavery or something prior to it. Either way, the net result is that an identifiable group of humans will have an intelligence distribution shifted to the left.
Note that my claim had nothing to do with genetics - the genetic influences are trickier to pin down than the racial differences. Also, there is significant evidence that at least part of the black/asian gap is caused by factors other than racism and genetics - namely the overperformance (relative to black Americans) of black immigrants.
http://www.unz.com/article/closing-the-black-white-iq-gap-de...