The issue with this sentiment is that while some things are blatantly racist, there are other things that aren't so black and white. This is one of those slippery slopes where if left unchecked, anything and everything will be considered racist.
Also, you don't have to have good morals or even be intelligent to be good at your job. Some people are fantastic at their job, but are pretty damn "stupid" as you put it.