If you're an American to whom general-audience American television doesn't make complete sense, and who misses many of the cultural references, then I'm quite relieved that I have a different interpretation.
I've seen a fair amount of British TV, and I'm fairly comfortable with the idioms and vocabulary differences. Less so than American TV, but I think that's fair, since I'm not immersed in the culture.
I've seen much less Australian TV, but a lot of the slang was utterly unfamiliar to me, in what I have seen. I'm sure that if I watched more, it would become more familiar.
I don't understand what is so controversial about the idea that other places use the language slightly differently, and it can take some time to become accustomed to the differences.