I was wondering if these models would perform in such a way, given this week's X/twitter storm over Gemini generated images.
E.g.
https://x.com/debarghya_das/status/1759786243519615169?s=20
E.g.
https://x.com/debarghya_das/status/1759786243519615169?s=20
Why?
Why are there three links to this question? And why are people so upset over it? Very odd, seems like it is mostly driven by political rage.
So if you're trying to be as unbiased as humanly possible, you might say, just use the raw datasets that exist in the world. But we live in a world where the datasets themselves are often biased.
Bias in ML and other types of models is well-documented, and can cause very real repercussions. Poor representation in datasets can cause groups to be unfairly disadvantaged when an insurance premium or mortgage is calculated, for example. It can also mean your phone's ML photography system doesn't expose certain skin colors very well.
Even if it was trained with a statistically representative dataset (e.g. about 2/3 of the US is white), you want your model to work for ALL your customers, not just 2/3 of them. Since ML has a lot to do with statistics, your trained model will see "most of this dataset is white" and the results will reflect that. So it is 100% necessary to make adjustments if you want your model to work accurately for everyone, and not just the dominant population in the dataset.
Even if we aren't using these models for much yet, a racist AI model would seriously harm how people trust and rely on these models. As a result, training models to avoid bias is 100% an important part of the agenda, even when the agenda is just creating a model that works well for everyone.
Obviously, that's gone off the rails a bit with these examples, but it is a real problem nonetheless. (And training a model to understand the difference between our modern world and what things were like historically is a complex problem, I'm sure!)
So they made the models blatantly, explicitly racist. Well done.
There's way too much politics in these things. I'm tired of people pushing on the politics rather than pushing for better tech.
Yes, it's absolutely intentional. Leaked system prompts from other AIs such as DALL-E show that they are being explicitly prompted to inject racial "diversity" into their outputs even in contexts where it makes no sense, and there's no reason to assume the same isn't being done here, since the result seems way worse than anything I've seen from DALL-E and others.
I'm surprised you're not attacking google over this then...
https://gemini.google.com/share/ba324bd98d9b
At least it would never make such a heinous mistake like that :)
That's my contention: the focus on this one thing belies not a concern for truth, but a concern for race politics.
"Depict the Girl with a Pearl Earring"
https://pbs.twimg.com/media/GG33L6Ka4AAC-n7?format=jpg&name=...
People who are driven by political rage, gaslighters, are really something else, agreed.
Google has been burnt before, e.g. classifying black people as gorillas in 2015, so I can understand their fear when they have so much to lose, but clearly they've gone way too far the other way and are going to have to do a lot to regain people's trust. For now, Gemini is a play toy
These cowards will never regain my trust. I won't hire or work with or for googlers or any DEI people ever.
I’m sure they’ll be very sad not to work with you.
Seeing Google on a resume has been an increasingly mixed signal for about a decade. Ask around.
I can only speak for myself: after Gemma these types are radioactive. I’m done.
I think you’re in for a rude awakening.
[0]: https://www.ssb.no/en/innvandring-og-innvandrere/faktaside/i...
https://www.statista.com/statistics/586719/foreign-populatio...
In fact it was quite adamant regardless of the time period or geography.
Rather mysteriously if you try it now as opposed to when it came out the results currently only show non-immigrant Norwegians. So is it wrong now? Because now it switched to exclusively ignoring the 4.5 million immigrants and only showing me the boring OG Norwegians.
I for one am outraged that the 8.9 million people of color Norwegian immigrants are presently under represented by Google. There is a serious risk of misleading people.
Pretending that a shoddy AI image generated with a blatant inability to produce consistent output is a "serious risk" is ridiculous. The thing wasn't even able to give you a picture of the founding fathers that didn't look like a Colors of Benetton ad. I struggle to imagine what tangible risk this "misinfo" would have. Norwegians being the wrong color? And what harm does that do? Bad assumptions about the prevalence of sickle cell anemia?
If I ask for a Bolivian woman, I expect a colla or a camba. Not a japanese woman, despite Santa Cruz having a very large japanese population.