Timnit Gebru on her sacking by Google, AI’s dangers and big tech’s biases
theguardian.com
theguardian.com
This is why I object to teaching kids about racism in schools. Maybe the teacher was racist. Or maybe she got good grades—which isn’t hard to do in American high schools—but her teachers didn’t think she was one of the exceptional kids who could go on to excel in the field as a career. If you aren’t socialized to think of yourself as the target of racism, the natural response is to probe further. “But my grades are good!” The explanation that comes next might lead to learning and growth, or at least renewed motivation (“I’ll show him!”) But if a kid has been socialized to perceive such interactions in terms of racism, there are, they can’t learn from such conversations. After all it’s pointless arguing with a racist, nor can you learn anything valuable about yourself from a racist.
I moved to Virginia from Bangladesh back in the 1980s, to a school and neighborhood that was nearly 100% white. At the time, northern Virginia where we were was solidly Republican. But my parents never taught me about “racism” and it was a tremendous blessing. I never wondered whether the ordinary negative interactions of life were racially motivated. Was that kid being a bully because I was brown, or because I was a book worm? What good would it have done me to recognize it anyway?
I’m extremely worried about how the discourse is going to affect my kids. It’s impossible to protect your kids these days from folks like Gebru.
I found this curious when reading the article and expected more context as to why this was racist. Why did Gebru consider this was due to her race or immigrant status? I got this comment through my whole life too even though I don’t share Gebru’s background or demographic factors. Were my teachers racist? Or were they concerned? Or was the subject just really hard? Or were they classist against my poverty?
It seems more info is needed and attributing this to racism (or sexism or xenophobia) seems like an unsupported conclusion. Although it seems Gebru felt it was racist and significant enough to mention in the background for this article.
I think this is what makes measuring micro aggressions so difficult. It’s rare to confirm the intent of the person who did something that is perceived as micro aggressions but the recipient feels and infers an intent.
I don’t know how to fix this but I want to.
I remember once remarking to a coworker that they had a nice car. It was a new 7-series and looked really nice. I thought nothing of it as it was just small talk and I frequently make such small comments to note something positive.
A few months later we were having a large zoom call after the George Floyd murder where people were recounting persistent and systematic racism. My coworker shared an example of what he called everyday racism when someone said he had a nice car and he assumed it was because he was black and couldn’t afford such a nice car. He seemed really hurt and spoke for 5 minutes about it and how he worked really hard to afford the car and his spouse had a high income as well. He didn’t name me as the person who made the comment but it sounded like my small comment.
I was so confused as to how all that could be inferred from “nice car.” I don’t know him well enough to ask about it and clear it up. I felt bad he was hurt, even though I just intended it as a small comment recognizing a nice car from a coworker and would have made the comment regardless of his race. So I don’t think I did anything wrong but still feel bad. And there’s no way I could predict such a response.
I don’t compliment coworkers cars any longer.
It's unfortunate, but for you to feel guilty and to stop this seems unreasonable. There are myriad of traps I can imagine you'd be afraid of falling into. Like, "Oh I want lunch and I fancy some fried chicken. Oh wait if I invite [black colleague] will they be offended at the suggestion to go for that food?"
Communication goes through filters, as this cheap graphic shows, and I don't think it's something you can fix on your side:
https://external-content.duckduckgo.com/iu/?u=https%3A%2F%2F...
I also never suggest friend chicken for lunch. I love fried chicken. I make a pretty good friend chicken. I’m just too timid and over leveraged to risk having it perceived incorrectly.
A more standard response may be: “oh that was me. Your car is better than mine. Sometimes you know, a compliment is just a compliment.”
I’m currently reading Hunting Eichmann. Really nasty stuff that went down, as many know. A very strong reminder that so many of these first-world problems, micro-aggressions, sympathy-seeking woe-is-me public sob stories are just crap. Seriously?? He felt bad from a complement about his car??
I feel bad for both of you. This anecdote seems to capture everything wrong with the current climate of discussion on these topics in the US right now.
> I don't compliment coworkers cars any longer.
I'm starting to think these "micro aggressions" are just a way to keep a culture war going, because some groups need a cause to fight for (for political reasons).
It reminds me of the whole master vs main debate.
A (black) engineer colleague of mine told me about his team's effort to change master to main. The whole initiative was started by a rainbow colored hair (white) PM and since it was what they believed to be a highly visible and easy fix, grew to a team of 5. All non-technical PMs of course. They ended up producing a "manifesto of inclusive software" where they listed every word they considered offensive and what it should be replaced with and made a very public announcement regarding the change.
The only response to their email was my (black) colleague asking if the branch renaming could be postponed to after a release because he didn't know what it could break in the build and release automation in case "master" is hard-coded somewhere.
This apparently started a lengthy thread between him and the 5 PMs where they explained to him that the reason he wasn't supportive of the change was because of the "systemic and cultural racism" he apparently internalized.
Precious.
[1]: https://www.sciencedirect.com/science/article/pii/S000145751...
And it's sad that many of the comments here are reactionary and hostile towards Gebru. Why is the community here so bad? I thought it's supposed to be full of smart people with computers?
Her paper aren't really high quality. Her carbon footprint calculations had all of Google's compute running from jet fuel. [0]
In her "Gender Shades" paper she completely ignored the existence of the Asian race. That's a pretty big limitation for a paper named in such general terms. In another place she labels Asians as "white adjacent".
She can't argue about technical subjects (here's an example [1]) because she isn't technical.
[0] https://www.technologyreview.com/2020/12/04/1013294/google-a...
[1] https://syncedreview.com/2020/06/30/yann-lecun-quits-twitter...
In the "Gender Shades" paper [2] as you call it, she doesn't use race but dermatologist approved Fitzpatrick Skin Type in their analysis as a proxy which of course covers all people including Asians.
The kind of bullshit (a technical term) response you gave is common among reactionaries who don't read, and can't do science.
[0] https://dl.acm.org/doi/pdf/10.1145/3442188.3445922
[1] https://arxiv.org/pdf/1906.02243.pdf
[2] http://proceedings.mlr.press/v81/buolamwini18a/buolamwini18a...
Erasing Asians from stats when convenient has been a staple of the CRT movement for quite some times (when, for example, their existence break down stats "proving" racism against non-whites). The term "white-adjacent" has become one of the dog whistles of the movement.
In regards to CRT, CRT has always included Asians, for example, studying the Chinese Exclusion Act in the US. Many people who criticize CRT (mostly on the right) have no idea what it is.
It seems to me that the anti-CRT crowd (mostly right-wing reactionaries) are making shit up to bring down this kind of important research in AI down.
Quite the opposite.
https://unherd.com/2022/02/anti-racism-betrays-asian-student...
https://www.goodschoolsguide.co.uk/schools/500658/thomas-jef...
The demographics of the school are indeed mostly Asian, and 97% of the pupils pay full tuition. Which means you have to be really well off to afford it.
https://schoolprofiles.fcps.edu/schlprfl/f?p=108:13:::NO::P0...
Is this article really about merit? or is it actually about wealth?
The first citation the article talks about her citing someone else's work about carbon footprint. So firstly, they're not her calculations - the paper is by Strubell[1]. Secondly, the paper absolutely does not assume the compute is running from jet fuel! It calculates the total energy to train a model and then uses US EPA data to show how much CO2 that would be in practice and then compares that to how much CO2 emissions a flight puts out. Honestly, I don't know where on earth you got this rubbish about running Google compute on jet fuel.
Secondly, you claim she isn't technical, she has a Masters in Electrical Engineering, a PhD in Computer Vision, and has had a fantastic career. Again in the actual link that you cite she is described as "technical co-lead of the Ethical Artificial Intelligence Team". I just don't know what you think you're doing citing things that directly contradict your claims.
If you think that Gebru is terrible, I would thoroughly recommend you talk about her less, because your attacks on her are so poor it lends her credibility. I'm fairly undecided on her - I literally don't know enough to judge, but your arguments are very poor.
As for being technical or not, well, none of her work seems particularly interested in technology. It's all grievance studies stuff. Having academic credentials counts for nothing because universities are so obsessed with race ideology they'd happily award black females computing-related qualifications on the back of nothing. It supplies no credibility.
>none of her work seems particularly interested in technology.
Honestly! Her PhD in computer vision seems pretty technological to me.
Fine, if the position you want to have is all universities are race ideology centres great, again, it reflects more on you than on anyone else.
I looked up her PhD:
https://stacks.stanford.edu/file/druid:xg519hx1735/thesis_ad...
In her own words it "pertains to using large scale publicly available images to gain sociological insight" and is about "visual computational sociology". The primary reported finding is that you can predict things like racial demographics based on what brands of cars are being driven around. It's consistent with a primary interest in society and not technology.
You said
> none of her work seems particularly interested in technology
Here is a very representative quote from her PhD thesis which you clearly did not really look up
> Augmenting Existing Adaptation Algorithms with At- tribute Loss > We can augment any existing adaptation algorithm with our attribute based losses to perform adaptation at the attribute as well as the class level. Here, we describe how we apply our method to [116]. To use our method with [116], we add the domain confusion and...
It's clear you will talk any amount of dishonest nonsense to make your point
It's reasonable to expect given that description for her PhD to be actually in computer vision. You know, a new SOTA on some well known benchmark or something. Some new general technique useful to anyone who deploys computer vision. Even she doesn't claim that's the case, the dissertation title claims it to be visual computational sociology which would be a different field. Her findings are pure sociology, there's no outcome here which is about computer vision (beyond "hey CV seems to work").
The original point was she doesn't seem very interested in technology. I don't see how a PhD that is at least 50% sociology disproves this point, it clearly supports it. And that's before dealing with the general dishonesty that pervades woke universities; who knows if the thesis can even be taken at face value? A place like Stanford wouldn't hesitate to misrepresent things for equity purposes.
You're quite literally making nonsensical complaints.
The exact power characteristics of TPUs don't matter because as I keep repeating and you guys keep desperately trying to ignore, Google years ago committed to buying renewable power 1:1 for the consumption of their datacenters. It doesn't matter how that splits between CPU, TPU and GPU, it's all covered by them.
Therefore, Google's computations net out to zero carbon emissions.
Most organizations don't do this. On average, a kilowatt hour of consumption is not from renewable sources. Therefore, Gebru's use of average emissions would be valid at other companies but not at Google, which means she was lying in order to gain impact.
Honestly, this point isn't hard to understand. It's difficult to escape the feeling that if she was a white man, it would all be clearly received.
That's an urban legend btw. The issue was actually that the person for whom it failed had the camera pointed straight up with a bright light behind him, so the image was totally washed out and lacked saturation. The software failed in the same way if you had a dark background and then shone a bright light into a white person's face. The algorithm needs contrast to work.
Also, people on this forum really should know better than insinuate that a program working imperfectly is caused by racism. As if programmers sit around finding ways to troll black people by deliberately making face recognition not work. Even the idea of it is absurd. When people make such insinuations, it reinforces the widely held belief that accusations of racism are invariably bullshit, which can lead to a boy-crying-wolf problem.
Note that the abstract speculative future concerns Altman and Hinton are concerned with are very different from the immediate and present issues Gebru, her former Google colleague Margaret Mitchell (now at Huggingface), and others in the AI ethics space are raising.
I stopped reading there.
I'm white I'm male I have 0 advantages because of that. Always the same lies everywhere. I'm tired of it.
I don't believe that my "way of thinking" is meaningfully different from the way of thinking of a white person, language and cultural differences accounted for.
Actually, I firmly believe that implying that is profoundly racist. It's small wonder that I see most dangerously racist bullshit being parroted in progressive circles.
This was the claim. And I refuse this notion. The worst atrocities humans inflicted upon one another were derived from a fundamental belief that the "others" being oppressed were meaningfully different from the oppressors, and therefore was ok to oppress them.
And about people treating you differently based on their perception of you, that is a different claim. And that is just basic human nature. Everyone (man or woman, white or black) judges based on appearances, especially when that is the first (and sometimes only) information you have to navigate.
I fail to see how my reply was misplaced. I'm basically on a subthread commenting on the same claim I chose to address.
> I don't disagree with you so far.
Good. This was a good conversation then. Have an excellent day.
Question: why does everything have boil down to a mortality lesson? Why can't white guy from the other thread have a little gripe? What's the purpose of scolding him , telling him that his opinion is wrong, and then treating him like a kid by sending a link to a cartoon that casts him as a snobbish, indifferent, predator?
Please stop helping.
Even if it were true how would you know?
I think a better question would be "How would YOU know?"
https://slate.com/technology/2023/05/openai-chatgpt-training...
Virtue signal by donating to my slush fund.
Wonder when this crosses the line and becomes some sort of fraud. Did they tell people they'd spend grants on AI research? A lot of their stuff seems very close to political advocacy and lobbying. They flat out state they hired activists and advocates. A 501c3 is supposed to have tight controls on political operations though.
Some technologies are leveling. It may be debatable, but I've heard it argued that the musket was one of these. The musket was cheap. It rendered expensive mounted plate-armored aristocratic warriors obsolete. Down came the whole feudal hierarchy necessary to keep those horses fed.
These AI models are the opposite. They do not spread power around; they centralize it. They increase dependence.
So in many ways she's right.
What I would like to ask, though, is -- instead of deepening the intersectional cuts that were used to dismember Occupy, what can a technologist do to both reduce centralization and increase solidarity? Is it possible to have a broad-based populism that isn't particularist? What technologies could be in its arsenal?
Possibly AI (which is really compression) can be part of this if it enables offline, disconnected "compressed Internet"s to exist off-the-grid, like solar panels?
How do we reduce dependence on the platforms? The different ethnic factions wouldn't fight each other if they were more self-sufficient. If they weren't made to compete with each other for access to a small number of economic chokepoints. How do we destroy the chokepoints? "Fuck your Suez, your Panama -- we have airplanes."
https://www.platformer.news/p/the-withering-email-that-got-a...
Hi everyone,
I’m sure many of you have seen that Timnit Gebru is no longer working at Google. This is a difficult moment, especially given the important research topics she was involved in, and how deeply we care about responsible AI research as an org and as a company.
Because there’s been a lot of speculation and misunderstanding on social media, I wanted to share more context about how this came to pass, and assure you we’re here to support you as you continue the research you’re all engaged in.
Timnit co-authored a paper with four fellow Googlers as well as some external collaborators that needed to go through our review process (as is the case with all externally submitted papers). We’ve approved dozens of papers that Timnit and/or the other Googlers have authored and then published, but as you know, papers often require changes during the internal review process (or are even deemed unsuitable for submission). Unfortunately, this particular paper was only shared with a day’s notice before its deadline — we require two weeks for this sort of review — and then instead of awaiting reviewer feedback, it was approved for submission and submitted.
A cross functional team then reviewed the paper as part of our regular process and the authors were informed that it didn’t meet our bar for publication and were given feedback about why. It ignored too much relevant research — for example, it talked about the environmental impact of large models, but disregarded subsequent research showing much greater efficiencies. Similarly, it raised concerns about bias in language models, but didn’t take into account recent research to mitigate these issues. We acknowledge that the authors were extremely disappointed with the decision that Megan and I ultimately made, especially as they’d already submitted the paper.
Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback. Timnit wrote that if we didn’t meet these demands, she would leave Google and work on an end date. We accept and respect her decision to resign from Google.
Given Timnit's role as a respected researcher and a manager in our Ethical AI team, I feel badly that Timnit has gotten to a place where she feels this way about the work we’re doing. I also feel badly that hundreds of you received an email just this week from Timnit telling you to stop work on critical DEI programs. Please don’t. I understand the frustration about the pace of progress, but we have important work ahead and we need to keep at it.
I know we all genuinely share Timnit’s passion to make AI more equitable and inclusive. No doubt, wherever she goes after Google, she’ll do great work and I look forward to reading her papers and seeing what she accomplishes.
Thank you for reading and for all the important work you continue to do.
-Jeff
I am glad they included that at the start of the article so I know to completely skip reading it!
I think the guardian article is a reasonable write up of the issues.
She quit/was fired for submitting a paper without following company procedure. Saying she lost her job after pointing out AI ethics issues paints a completely different picture and is not productive at all.
I think that this is a simplistic and incorrect summary of why she no longer works for Google.
It would be as accurate as if the article started with “lost her job after violating Google’s publishing clearance procedures and sending out inaccurate and accusatory emails to internal listservs”
Honestly, a very boring read. Brings nothing new to the discussion, and at times feels just shy on gushing about the subject matter.
As for her being fired from Google... Google being Google, thet're probably in the wrong. But it is not surprisingly in the slightest that this sort of activist employee ends up being sacked when they start to be troublesome in their activism. Hell, I wonder why Google even hired her in the first place. My guess is that they hoped that by receiving a paycheck, she would be neutered.
They bike shed all day. Just regurgitate old stories and what ifs.
They never do anything quantifiable, they don't have the technical skills.
Unlike middle Bullshit jobs that do nothing, they instead drag down employees around them.
Case in point here and as we can see Google is currently losing the AI battle.