All this obsession with race is just a way for the elites to urn attention away from actual solutions which would hurt their profits.
In the United State our history makes it absolutely about race too. The legacy of slavery and racial segregation didn't magically disappear in 1965. The limited amount I know about Canadian history is that something similar could be said about the treatment of First Nations.
If you agree the US has a history of slavery and racial segregation, of course it will still offer privileges to white people because that's historically how the system was setup. When do you think that stopped affecting black people?
You're right, there's no insult intended when people say that. Apparently whiteys have thin skin too!