A more accurate phrase is "guest workers", but given your context you probably meant to use the word "foreigners". Someone on the flip side might use the phrase "indentured servant".
In the larger debate, the criticisms are well known (see http://en.wikipedia.org/wiki/H-1B_visa#Criticisms_of_the_pro... ), and many seem both of substance and disconnected to xenophobia. For example, some opponents to the current H-1B process want the H-1B visa holder to be able to change jobs without losing their place in line for the green card, which would benefit the ex-pat worker whose options are otherwise "grin-and-bear-it" at a hated job or leave the US.
As such, it's likely that your prediction of bigotry based on the information you read, has a high enough error rate, and a strong likelihood of poisoning the discussion, that it's not worthwhile to state.