Hacker News Reader

Comment by lwansbrough | Hacker News Reader

Pretty shameful for the programmers who implemented this.

I wouldn't be surprised if it was sold to programmers as a "dynamic block list" so they could respond to the changing landscape of slurs, and then execs decided to use that functionality to add these other words.

Which tangentially, is 100% why any Apple (Or other) engineer building "on device" CSAM scanner that is remotely update-able should think really hard...

"It should be noted that no ethically-trained software engineer would ever consent to write a DestroyBaghdad procedure. Basic professional ethics would instead require him to write a DestroyCity procedure, to which Baghdad could be given as a parameter."

No programmers implemented this yet.

> a planned internal messaging app

> “This particular program has not been approved yet and may change significantly or even never launch at all.”

> “If it does launch at some point down the road,” said the Amazon spokesperson, “there are no plans for many of the words you’re calling out to be screened. The only kinds of words that may be screened are ones that are offensive or harassing, which is intended to protect our team.”

Apparently meaning: they were caught, so now they have to rethink it.

Yeah, this leak is about a brainstorming session.

It was a stupid suggestion that apparently hasn’t seen the light of day.

Looks like it went further than just a brainstorming session, because a list of words and phrases to be blocked was assembled and this is what leaked. It isn't clear whether or not they would have proceeded if there hadn't been a leak.

> It isn't clear whether or not they would have proceeded if there hadn't been a leak.

Right, just many folks on this thread like OC insinuating that it's already been built.

I think asking why this idea got as far as it did is a valid question. I mean creating an app and filtering for profanity is standard. But then who hijacked the list and added pretty benign terms?

Those aren't benign terms, because that kind of filtering might violate labor relations laws in the US, depending on the details.

Sorry, I mean benign in the sense of them not being vulgar or violent. They are still certainly important words.

This is pure speculation, but I wouldn't even be surprised if didn't have any say in this. What likely happened is that higher ups proposed a new feature to ban certain words, likely phrased as a way to remove racist and/or derogatory words.

As a software engineer today, you always have a say in what work you perform with your own hands.

You might think a big enough paycheck compensates for an ethical infraction, but it's a decision you alone make.

Read the article. There was apparently a meeting where there was a discussion about whether free text should be allowed in a kudos-granting app. It's possible, even likely, that nobody has implemented anything.

What are they going to do? Refuse and lose their ridiculous salary? If only there were a way for workers to make a stand on this together, some kind of way to demands as a group.

Reply on news.ycombinator.com