A good chunk of the English lexicon was foreign at one point or another: https://en.wikipedia.org/wiki/Inkhorn_term