The word ‘white’ means a lot of different things. Those groups may not have been considered white socially but they were always legally white for the purposes of immigration, not being enslaved, not being subjected to Jim Crow.
https://en.m.wikipedia.org/wiki/Immigration_Act_of_1924
Of course they didn’t have it as bad as black Americans, but that isn’t the topic of this discussion.