Nobody targeted anyone’s immutable characteristics. If you object to 10,000 Appalachians being resettled in your New England town, that’s not “racism.” It’s an objection based on not wanting them to do to your town what they did to their hometowns in Appalachia. It’s about peoples’ culture and how that manifests in the communities they create.
I think this is hard for liberals to understand because they’re so steeped in cultural relativism. They assume that cultural differences cannot be substantive—cannot shape the communities people create in substantive ways. So they cannot understand why anyone would object to mass settlement of culturally distinct groups except out of prejudice against immutable characteristics. Oddly, they seem to have this blind spot only for non-white people. Most would agree that West Virginia is the way it is because of West Virginians. But Bangladesh isn’t the way it is because of Bangladeshis, and it’s “racist” to suggest that importing 50,000 Bangladeshis to an enclave in the US would recreate dynamics that prevail in Dhaka.