I wonder if this is why people are uncomfortable with autistic people. Some subtle details of behavior are missing and they can't identify what because all the superficial features may be present. They'll tolerate it for a little while but eventually get sick of not being able to relax and accept the person as fitting into any desirable or known type of personality.
Perhaps moving to a foreign country makes it easier because you're obviously different - like a cartoon character or upside-down Thatcher.