I'm not speaking of people failing to navigate local bureaucracy or "having a harder time coping with the expectations of Japanese society". I'm talking about theft, battery, and homicide (for which the stats are hardest to dispute).
Regardless of your feelings about assigning blame, it's very hard to fault people for choosing to decrease the likelihood of themselves and their fellow citizens from suffering harm from more outsiders.