Samsung's AI photo feature adds creepy teeth to baby photos
boingboing.net
boingboing.net
https://twitter.com/earcity/status/1638582541706829824
It's not just adding teeth it's actually changing the facial features which seems completely insane to me. Is it just me? Like this is a terrible application of this technology.
Facial recognition is a bunch of snake oil
Other manufacturers cheap out on that part, or prioritize design (no notch/camera hole) over security.
/joking of course
I'm not sure why you think this was something that only happened in "East Asian cultures" until now?
There are large percentage of the population who has not posted a non-retouched version their photos in years
Everyone bemoans it but they do it anyway because otherwise you feel like you can’t compete.
It leads to wide spread body dismorphia and severe self image issues
I think self-esteem transcends culture. You can call it colonialism, but I say you want people to suffer. Because culture!
Also, unrealistic beauty standards are fairly universal. These awful beauty apps are but one solution, and they are gaining ground here in the west. Is this a case of eastern colonialism? What about TikTok?
Empowering people to feel comfortable in their own skin, as they are. How could anyone not want that?
If you cut someone, and they heal, that doesn't erase the fact that you cut someone. The important thing is not to cut them.
My friends here drive me crazy with their self-conscious body-shaming because they grew up constantly surrounded by impossible images of beauty. They do this so much that it is a nuisance. And what we have here is but a fraction of what it sounds like the east has. People living under your system must be positively insufferable then, without their precious beauty apps.
To be clear, I'm against any fake anything. Fake tits, fake lips, fake asses, fake selfies.... unless there are medical reasons it is all garbage.
Doesn't sound like such a ridiculous thing to complain about anymore, does it? Do you at least see why some people may be opposed to further steps in that direction, even if you yourself is fine with it?
https://www.theverge.com/2023/3/13/23637401/samsung-fake-moo...
To be clear, they’re adding detail that the camera can’t see. What they’re doing is more sophisticated than substituting a reference moon.png in place of your shot, but it’s adding Samsung-provided detail if it detects a moon either way.
So if a new crater appeared on the moon tomorrow, their camera would need a software update to capture it.
Source? Afaik it was using ANNs to upscale, not dropping in previously taken images.
Samsung made use of the fact that the moon always looks the same from our perspective as it's tidally locked, meaning image "improvement" algorithms can more or less copy-paste moon surface details into the image (yes, of course it's more complicated than drawing moon.jpg over the picture, but the end result is the same).
“People added additional craters” … no they didn’t. Without knowing anything about what people interested in stress-testing Samsung’s software did, I can say that because if they did really add additional craters, it’d be front-page news.
I assume what people did was added artifacts which are not real (let’s call it ‘fictional’) to an image. Samsung’s software enhanced it as long as these fictional artifacts conformed to its notion of what a blurred crater looks like.
So it turned fictional artifacts into higher-res fictional artifacts. At this point, you might as well generate the moon image in a terrain generator like World Machine.
Put it another way, if Coca-cola tomorrow puts a giant billboard that says “Drink Coke” on the moon, and it turns out Samsung’s software didn’t expect that, it’ll need a software update.
More realistically, if tomorrow you have a lunar impact crater with a shape distinctive enough that Samsung’s software doesn’t expect, again, you’ll need a software update.
And that’s the heart of the issue: the camera is no longer capturing reality, but instead injecting detail that someone at Samsung decided would be appropriate for your shot.
This genuinely isn't informative evidence of how the process works. You're not seeing the raw samples from the camera, which are going to be very noisy even if you're showing it a white circle. "It's actually the moon" may be a reasonable belief given the noise level.
I know how strangely offensive this all sounds but it's completely factual - there's some lost in translation thing that is I'm assuming benign and normal in some other culture which comes across as pretty inappropriate and even a bit racist to Americans.
Incidentally on a tangential note, this is why most front facing cameras on phones, tablets, and laptops mirror the video feed on your own screen: To trick your brain into thinking you look OK.
Lots of reply was just "so what?"
Obviously lots of people just don't care .
I don’t know at what point it stops being a photo any more. In many ways I suppose it doesn’t really matter but I wonder if I’ll be looking at my kids graduation photos and seeing a smile an AI has approximated my child probably had in the moment based on previous photos and stock photography of graduations.
Personally, I think it's at the point that you start using AI/ML for anything other than the parameters involved in capturing the raw image (focus, shutter speed, aperture, etc) and the parameters of RAW processing/the sorts of editing that's allowed in a typical photography competition (so things like exposure, white balance, colour adjustment, etc).
Essentially I think as long as the photo is built up from data captured by the camera sensor(s) and no additional data is “added” to the photo, no upscaling, no substitution, no textural or morphological manipulation of objects in the frame, then it’s still a photo even with sophisticated AI processing. But the moment you upscale, airbrush, or morph anything… not a photograph.
When any form of object recognition is involved.
Sharpening also benefits from object segmentation because you don't want the effects to bleed over into different areas, you get halos that way.
I don't know of any implementations of this, but an interesting one would be auto white balance. It's typically done as a global slider, but if the image has multiple light sources this doesn't always look good.
And actual straight-up "knowing what's in the scene" AI can help too; people shouldn't look sickly in your photos just because they're under a low-CRI yellow light. You probably want to know what color skin tones actually are.
I don't want any upscaling at all in my photos. One pixel on the sensor must correspond to one pixel in the output.
JPEG files also don't have pixels: https://en.wikipedia.org/wiki/Chroma_subsampling
Then again, OLED displays don't either: https://en.wikipedia.org/wiki/PenTile_matrix_family
Lightroom and at least one current phone camera have ML Bayer demosaicing for this reason and it's visibly sharper.
(Note sharpening and enlarging are the same operation.)
We’re there.
https://arstechnica.com/gadgets/2023/03/samsung-says-it-adds...
You realize this is not too different from what the SuperResolution networks are doing, right ?
Considering that Ansell Adams would spend weeks reworking his negatives to get the perfect print I think that you'll find that horse bolted a very long time ago.
It was slower and harder to do than with digital editing, but it was absolutely common-place and normal.
Here's a good overview of some of the old processes and timelines:
https://fixthephoto.com/blog/retouch-tips/history-of-photo-r...
It was slower and harder to do than with digital editing, but it was absolutely common-place and normal.
As someone who grew up in that era, I can say all the family photos have not been edited, nor would the majority of people who owned a camera back then spend the time or money to do so. Yes, commercial photo editing services have always existed, and of course you'd expect things like magazine covers and other prominent, publicly published photography to be heavily edited, but they didn't automatically do it to everyone's photos for free; and that's the huge difference between then and now.
Whoever developed your photos would've adjusted the brightness and white balance based on what looked right to them if nothing else. Send the same negatives into two shops and you'd get different-looking pictures back.
It was an automatic process and colours were consistent. I find that reading theories about what might have happened 20 years ago is becoming pretty annoying. I shot some kind of Fujifilm mostly and if it was under/overexposed that was like your problem.
Honestly I was thinking more of the "portrait studios", rather than the home-shooter. Though I guess in teh early days of cameras there were a lot of people who did their own development at home, in ad-hoc darkrooms. Maybe they didn't edit so much, but it was within their means, and I'm sure it was more commonly done than we'd suspect.
There is so little desire to capture the world as it is. We humans have to insert our bullshit desires and artifice into everything. And winner-takes-all capitalism means the majority market of morons is literally the only market that can be serviced cost-effectively (meaning... at all)
God I hate people so much. So much potential... wasted.
I want more investment in better optics and hardware. Not AI hallucinations.
Do you think some random internet comment is going to change anything? Even if it is worded in the best, most persuasive manner possible?
"Hmm, that pdntspa guy on Hacker News is right goshdarnit!", says the Megabux CEO as he jumps out of his chair. "Sheila, get me the engineering director on the line. Tell him to cancel all our AI products!"
Yeah.... not going to happen. Hence, a rant.
On the other hand, maybe the world needs more reminders that most people are pretty mundane, hardly able to get more than 2 people looking in the same direction for long enough to snap a shutter, just trying to get through life.
imho there's value in capturing that someone had a weird expression on their face or blinked.
Just look on Instagram. How could you compete with all those fit, beautiful and healthy people, if you don't heavily edit your photos.
(To be totally honest, I think that some beauty filters aren't as bad, because most people don't know how to hold their camera and tend to distort their face with closeup lenses.)
To be vain about it, there's enough drama and messiness in day-to-day life. I don't want to be reminded of that when I look back; I want to see the good parts, that it was all worthwhile.
But, more practically even, photographs capture history. You may not be thinking about it when you're just taking a personal photo, but a fair bit of history does come from personal collections. Especially less significant figures or events where those personal artifacts are the only things that even exist.
Its difficult to gain much useful information when the images are blurry, distorted, or covered in shadow. You may appreciate the funny face, but can a historian or a great-great-grandchild confirm the person in the photo when they are covering half their face in a sneeze?
That said, the pendulum definitely swings in the other direction, too. Despite all the information we gather these days, there may be less meaningful history for the next several decades because you simply can't trust any of it is actually genuine.
So HDR photography (taking multiple photos milliseconds apart and merging them) is fine, because it's just using information that was available while you were standing there taking the shot. I don't see how this is really any different from a long-exposure shot in fact.
Using a polarizing filter to enhance the sky color and see the fish underwater is fine, because it's just using information available that time (and in fact, selectively ignoring some information, namely light polarized the "wrong" way).
Editing light levels differently in different parts of the frame is OK too because that light is still coming to the camera, you're just processing it differently.
Going online to grab ultra high-res stock photography of the Moon to enhance your shaky-cam photo is not OK, because that's adding information that the camera didn't have available to it (and worse, it's quite possible the downloaded information is inaccurate).
Going back to your White House example, what happens if someone takes a photo of the White House lawn because they want a photo showing the new trees or flowers that were planted or just bloomed. But Samsung downloads some stock photo to "enhance" the photo, and of course this stock photo was taken before the plantings, or at some other time of the year when the flowers weren't blooming. Now this poor sucker has a completely invalid photo showing something that didn't exist when he took his trip to DC to photograph the White House lawn, and probably won't notice until he looks through his vacation photos on a large monitor.
https://www.theverge.com/2023/3/22/23652488/samsung-gallery-...
And even that is soon getting changed, with RAW getting redefined more and more to pick up the data later and later in the image processing pipeline...
https://www.howtobeadad.com/2011/3957/bad-product-baby-dentu...
Toothless babies? Perhaps your likeness is "invisible" to self driving cars. No one can assure you otherwise.
And self driving cars and justice.
But humans do not have the catastrophic failure modes the way AI does - like adding teeth to babies.
Adding AI everywhere is like adding nuclear power into every car - there is a new catastrophic failure mode and possibility of malevolent intent that we do not know how to deal with.
Obviously, adding teeth to a baby is insane in any situation, but it's not like you're taking a photo of a baby with no teeth and then seeing teeth in the photo.
I've used the Remaster feature a few times on outdoor shots and it generally does a good job of fixing a bunch of issues with a photo and enhancing details etc.
A "remaster" feature should never add teeth.
Nothing wrong with adding teeth, but it should be called the "add teeth" feature, not the "remaster" feature.
It was funny then, and it's still pretty funny now.
Pick a lane parents....
https://news.ycombinator.com/item?id=29739235
https://news.ycombinator.com/item?id=29750660
Maybe this is true, but it's worth remembering that this community is at Nigerian Scammer Mark level of gullibility.
We it's only a matter of time untill this type of fraud happens. It's just not possible to predict exactly when
No, I don't recall that. It seems you're manufacturing history. Did you see the photo? [1] It did screw up it up. The fact that the leaf existed does not negate the fact that the background around the leaf was changed to delete the face.
[1]: https://twitter.com/mitchcohen/status/1476351601862483968/ph...
https://www.theverge.com/2023/3/13/23637401/samsung-fake-moo...
Is that better or worse than Google's customer service?
We have no way to control these stupid things.
It would be like a remastered music album adding entirely new instrumentation.
Of a horse.
Underwater.
https://www.youtube.com/watch?v=OOdyTn2X9oQ (Adobe Enhance for podcasts from this year)
https://www.youtube.com/watch?v=wHduATM-o7M (Microsoft Songsmith from 15 years ago)
Actually there's a popular trend of recreating old video game soundtracks with uncompressed samples and calling it "remastered". Though, it looks like the most 'reputable' channel switched to "restored" for newer videos.
edit: Ah, I meant one of the worst articles I've ever seen.