Google's 'Reimagine' tool helped us add wrecks, disasters, and corpses to photos
theverge.com
theverge.com
- "Google Docs" allowed me to write death threat letters.
- My Brother printer allowed to print them.
- The postal service delivered them
- My Sony camera allowed me to take nude pictures of my neighbor through the bathroom window
We can't safeguard every tool. And I predict negative consequences will come from trying.
Like what on earth is the point of a "make anything I want" machine where whatever I want has to pass review with the focus testing groups of every major corpo in the world, lest they're precious advertisements end up within 100 feet of something your average suburbanite concerned middle-aged mother would find off-putting?
1:https://www.technologyreview.com/2022/11/18/1063487/meta-lar...
It is absolutely a performance but I'm not as confident as you are that it will eventually blow over like this. Adult-oriented content is getting regulated harder than ever, largely via the industrial-scale pearl-clutching of payment processors. Granted, it isn't strictly a moral objection; the moral objection is just a convenient excuse for banning companies that sell porn, because they have a much higher than standard charge-back rate and providers don't want to deal with litigating those cases since it's basically impossible to prove that you bought porn.
It's corporate cowardice in it's rawest form but I don't know if it will be overcome in the way you suggest, because fundamentally, what's causing the issue as it were, is shame about consuming adult entertainment, a shame that still grips vast swathes of the market and results in the aforementioned charge-backs.
Censorship is never a good thing.
Your username, association with a specific programming language, a misconfigured vehicle enthusiast forum, and a very unique aspect to how you use punctuation marks in your online comments (not the above comment but many others) has led me to determine with a high confidence your name and location of residence.
Would HN be censoring me if they deleted a comment containing this information?
I say yes. I also say that is a net positive, and their right.
What are they objecting to? Art? I can look at disturbing imagery by closing my eyes and imagining it. Let's ban my visual cortex.
Stuff like this gives journalists a bad name; it's selfish. It erodes trusts in the institution of the press for nothing more than a deadline and some clicks.
Maybe something will break, and the general population will become excellent at citing and verifying sources as a response to rampant fakes. However, given the generally sorry state of news and journalism, and seeing how many people on social media believe that AI slop is real, I'm skeptical.
We're basically already at the point where images and videos of unknown provenance can't be assumed to be real so how come people pay attention to journalists getting the vapors about scandalous things AI tools can do? Wouldnt everyone rather have a completely unlocked tool to do with as they will?
We’ve been dealing with the possible output of a few fake images per human per day ever since photography was invented, at most. Digital photography has maybe made it 10X easier.
Now that humans are not the limiting factor, we can have clusters of computers generating an unimaginable number of fake images 24/7. You can see how we’re not prepared for such crisis.
I mean people believe the earth is flat, despite being shown photos clearly demonstrating it's not, and this before even digital photos were commonplace!
AI generated photos won't give us any problem we don't already have, at least not until they're good enough to fool a forensics team and thus be admitted as evidence in a court of law. I wouldn't hold my breath for that one...
Of course not, but when the scale is suddenly many orders of magnitude more, it matters.
Of course the crazies are gonna craze, that probably won't change. But it is far from obvious that non crazies will be fooled by AI generated images of a flat earth.
They are not very smart people, in general, but very good at optimizing for the thing that gets them views: ragebait.
In this case, there’s nothing to be done for it. Ideally, Google spins off image models to a separate company that doesn’t hurt the brand.
The rest of us will have this tool. But perhaps it’s too much for the normies.
I will be requesting the addition of safeguards for everyone's protection.
Where exactly do you draw the line of where it's "too easy" to create a disturbing image? Knowing this will likely be the line where it's "too easy" to create any image.
I already didn't trust images. And so now I still don't trust them...
Yes, let's kneecap it because it's way too good. Safeguards just make users migrate to other services to generate what they want.
There is a massive difference between "it's on everyone's Android phone", "it's on everyone's Pixel phone" and "you gotta pay some dodgy web service 10 dollars in bitcoin" when it comes to abuse potential.
Creating disturbing imagery, especially of the kind that has the potential to uproot someone's life (think, fake nudity, association with known criminals) or in the worst case cause actual riots with real people dying (it's happened way too often that WhatsApp chain letters have caused that, now imagine this with convincing faked imagery!), should not be accessible at the push of a button. There must be placed at least some hurdle, or you'll get 4chan style trolling everywhere.
I think this shouldn't be newsworthy - the tool is just doing what you asked. It's the same as complaining with $pencil_producer that their pencils allowed you to draw disturbing images.
I think it would be more "newsworthy" if it would produce racist outcomes (e.g: asking it to draw a criminal and the tool produces always the same minority / output), but we're also probably past that - we've already seen those news articles.
So what? I can Photoshop some powder into a picture too. It might look better, but not really that much. I think the media needs to accept that images are no longer trustworthy unless there's some chain of evidence tied to them.
I can say "John was on the floor with a bucket of cocaine", that doesn't make it true.
and watching all the luddites on social media agree with the genAI person
https://en.wikipedia.org/wiki/American_propaganda_of_the_Spa...
Of course, nothing will be fool-proof, but perhaps something strong enough that social media websites require the uploaded media to have this provenance attestation as well.
https://contentauthenticity.org/
They’re the folks behind things like Content Credentials, and stuff like building digital signatures into the physical cameras taking the pictures.
I feel like this is similar to all technical progress. Once, only dedicated wizards could do something. Then, they are outraged when the general public can do it.
Misinformation sucks, but restricting access to photo tools is not the solution. Better education is. It's the solution to pretty much all problems. (And even then, people aren't as dumb as you may think. Trump is heavily using AI photos to claim that people are endorsing him, and I don't think anyone thinks that Taylor Swift is actually cosplaying Uncle Sam and endorsing Trump.)