Talking about race makes things which aren't about race about race, which introduces racism. Not talking about race lets the issue of race go quiet into that good night where it belongs.
You make it sound like the problem would go away if we'd just stop talking about it. That's not a solution; that's just sweeping it under the rug.
The problem ises some people know that they can discriminate against people based on skin color. They learned that certain groups had certain stereotypes. They learned these "facts" because people around them reinforced that these groups were different by talking about how the groups were different.
Talking about race is only going to beget more racism at this point.