What is wrong with loan-words in your mind? English takes a great many loan words from French without worrying about it. It's a natural part of language evolution that we embrace. It hasn't threatened the identity of English yet.
Well, granted, English and French have a special history as they both invaded countless countries to the point those two languages eventually became spoken on all continents. I guess it's only fair when it backfires sometimes, and there's a bit of irony when it happens between those two languages in particular.