The most common meaning of "racism" in conversation is "acting based on the race of some person / group of people".

Immigration policies can (should) be discussed without taking into account people's race, and still lead to racially-biased outcomes, simply because the majority of immigration-seekers have a race that's different from the majority of people in the target country.