> So the trade is your country gets (sort of) richer overall and the elites get richer while the average person gets poorer.

While the average salary decreases in this scenario it is entirely down to composition effects and does not necessarily mean anyone gets poorer.

Everyone existing employee's wages stay the same. The new immigrant paid less than the previous average but more than they were being paid in the country they moved from.