That is not as true as it sounds at first glance. For example, a statement like "blacks are more violent and less educated than whites" is factually accurate, but frames the situation in a definitely racist way if you just leave it at that because without elaboration, it makes it sound like a fact of nature.
This is the problem with "facts and statistics can't be racist". No, technically they can't be, but if your conclusion you're drawing is that certain ethnicities are just genetically more criminal, you're handling the facts in a racist (and very incorrect) way (not implying in any way that you think like that).