Well, read any AI bias paper. Facts about reality these models capture and which are considered problematic include stuff like "doctors are more often men and nurses are more often women" or "most people on the internet are white" or "most stuff on the internet is written in English". Basically the internet is mostly built by westerners and any facet of that gets classed as "bias" rather than being what it is: the truth.

Even trivial facts like in English "men chuckle, women giggle" has been used as examples of bias. That's not bias though, that's just how the English language works.

For example:

https://ai.googleblog.com/2020/04/a-scalable-approach-to-red...