"Check your privilege" is also a concise way of telling someone that, based upon factors of which they have little or no control, whatever opinion they are expressing has little or no value because they do not or cannot understand viewpoints from a different set of experiences.

Anotherwords, it's passive-aggressive bullying and belongs in the same category as telling a woman to stop worrying her pretty little head about such issues.