English has a wide variety of accents, expose yourself enough and its probably healthy for your brain. I used to not be able to understand different American accents and I'm from the Midwest. Context and patience is king.
I couldn’t care less whether it’s American English, British English, or whatever.
But to expect everyone in the world to be comfortable with all possible English accents in the world is madness.