People in the US stating that black lives matter get called racist. So, yes.
The question was asked if some US person might be called racist for having an opinion about gentrification that seemingly has little to do with race, and the answer is yes, yes they have been.