I will consider it racist, yes, I prefer a "colorblind" world. Btw, every person in South Africa is the descendent of a "colonizer", black or white.
While it might be nice to live in a "post-racial" world, it should be obvious that we don't, yet.
Fighting racism with even more racism, will world three opposite result. It's not the first time in human history, that people mean well and create hell. It's just a different topic this time.