I think there is a very real, uncanny valley effect (at least partially emotionally/identity grounded) with languages where it takes more experience and effort with recognizing a language (or dialect/accent) as a distinct environment requiring a code switch the more closely it resembles one you are very comfortable in, especially your native language, and especially if something about it specifically has become emotionally attached for you with your native language being spoken badly or by people of disfavored background.