> That the French wouldn't be so bothered if people came to France to be French and adopt the local manners and attitudes;

Maybe the non-assimilators wouldn't come to France if the French had not gone to North Africa and convinced them that France is awesome[1] in the first place.

1. Majority of France's Muslim population comes from it's ex-colonies.