It does, otherwise they're called immigrants.
The USA is exceptional because almost every visa that allows for work is considered an immigration visa (eg H1 leads to a greencard, eventually). But in other countries that is most definitely not true.
What I meant to say is that those people who the locals consider not "expat" anymore, but "backpacker" instead, must really have fallen low.
I came to the US as an expat, but became an immigrant.
If you tend to see racism behind every raised eyebrow, you can of course also see this terminology as racist.