It's mostly because societies, where they're minorities, actively work against their assimilation. Just look at the US alone where they're always the outsiders.