A better discriminator might be global edits vs local edits, with local edits being things like retouching specific parts of the image to make desired changes, and one could argue that local edits are "more fake" than global edits, but it still depends on a thousand factors, most importantly intent.
"Fake" images are images with intent to deceive. By that definition, even an image that came straight out of the camera can be "fake" if it's showing something other than what it's purported to (e.g. a real photo of police violence but with a label saying it's in a different country is a fake photo).
What most people think when they say "fake", though, is a photo that has had filters applied, which makes zero sense. As the post shows, all photos have filters applied. We should get over that specific editing process, it's no more fake than anything else.
Filters themselves don't make it fake, just like words themselves don't make something a lie. How the filters and words are used, whether they bring us closer or further from some truth, is what makes the difference.
Photos implicitly convey, usually, 'this is what you would see if you were there'. Obviously filters can help with that, as in the OP, or hurt.
Artists, who use these tools with clear vision and intent to achieve specific goals, strangely never have this problem.
For example, I took a picture of my dog at the dog park the other day. I didn’t notice when framing the picture but on review at home, right smack in the middle of the lower 3rd of the photo and conveniently positioned to have your eyes led there by my dog’s pose and snout direction, was a giant, old, crusty turd. Once you noticed it, it was very hard to not see it anymore. So I broke out the photo editing tools and used some auto retouching tool to remove the turd. And lucky for me since the ground was mulch, the tool did a fantastic job of blending it out, and if I didn’t tell you it had been retouched, you wouldn’t know.
Is that a fake image? The subject of the photo was my dog. The purpose of the photo was to capture my dog doing something entertaining. When I was watching the scene with my own human eyes I didn’t see the turd. Nor was capturing the turd in the photo intended or essential to capturing what I wanted to capture. But I did use some generative tool (algorithmic or AI I couldn’t say) to convincingly replace the turd with more mulch. So does doing that make the image fake? I would argue no. If you ask me what the photo is, I say it’s a photo of my dog. The edit does not change my dog, nor change the surrounding to make the dog appear somewhere else or to make the dog appear to be doing something they weren’t doing were you there to witness it yourself. I do not intend the photo to be used as a demonstration of how clean that particular dog park is or was on that day, or even to be a photo representing that dog park at all. My dog happened to be in that locale when they did something I wanted a picture of. So to me that picture is no more fake than any other picture in my library. But a pure “differentiate on the tools” analysis says it is a fake image, content that wasn’t captured by the sensor is now in the image and content that was captured no longer is. Fake image then right?
I think the OP has it right, the intent of your use of the tool (and its effect) matters more than what specific tool you used.
And if shot composition doesn't make it fake, what if I cropped the photo after the fact? I'm removing something the camera captured to better make the picture what I "felt like it should be" just using the removal tool. That's functionally no different from framing the shot differently, but it's modifying the actual captured image.
If we decide that removal, whether by framing or by post-hoc cropping is still "real" and it's the use of a tool that adds something that wasn't there, would the same apply to just cutting a square out of the photo without cropping the rest of the frame? A transparent square would be an interesting artistic choice for sure, but does that then get into the realm of "fake"? What if the square is black or white? Is adding a clearly "post process censor bar" crossing a line into making the photo "fake"?
If those are fine, it's the "adding content that looks like it should be there" is the problem, does that mean that dust or hair removal to remove something that was on the lens make it fake since that would also have to generate what the computer thinks is behind that hair or dust speck?
For what it's worth, I don't think there is a hard line here, like I said intent matters. But I do think that figuring out where ones personal and general lines are and when they might move that line or not is an interesting thought experiment.
The ones that make the annual rounds up here in New England are those foliage photos with saturation jacked. “Look at how amazing it was!” They’re easy to spot since doing that usually wildly blows out the blues in the photo unless you know enough to selectively pull those back.
If you want reality, go there in person and stop looking at photos. Viewing imagery is a fundamentally different type of experience.
We’ve had similar debates about art using miniatures and lens distortions versus photos since photography was invented — and digital editing fell on the lens trick and miniature side of the issue.
Portrait photography -- no, people don't look like that in real life with skin flaws edited out
Landscape photography -- no, the landscapes don't look like that 99% of the time, the photographer picks the 1% of the time when it looks surreal
Staged photography -- no, it didn't really happen
Street photography -- a lot of it is staged spontaneously
Product photography -- no, they don't look like that in normal lighting
A lot of armchair critics on the internet who only go out to their local park at high noon will say they look fake but they're not.
There are other elements I can spot realism where the armchair critic will call it a "bad photoshop". For example, a moon close to the horizon usually looks jagged and squashed due to atmospheric effects. That's the sign of a real moon. If it looks perfectly round and white at the horizon, I would call it a fake.
Ditto for black and white photos. Your visual perception has pretty high dynamic range. Not least because your eyes move and your brain creates a representation that gives you the illusion of higher dynamic range than what your eyes can actually deliver. So when you want to represent it using a technology that can only give you a fraction of the dynamic range you (or your camera) can see, you sometimes make local’ish edits (eg create a mask with brush or gradients to lighten or darken regions)
Ansel Adams did a lot of dodging and burning in his prints. Some of the more famous ones are very obvious in terms of having been “processed” during the exposure of the print.
I see this as overcoming the limitations in conveying what your eyes/brain will see when using the limited capabilities of camera/screen/print. It is local’ish edits, but the intent isn’t so much to deceive as it is to nudge information into a range where it can be seen/understood.
What about this? https://news.ycombinator.com/item?id=35107601
You can look it up because it's published on the web but IIRC it's generally what you'd expect. It's okay to do whole-image processing where all pixels have the same algorithm applied like the basic brightness, contrast, color, tint, gamma, levels, cropping, scaling, etc filters that have been standard for decades. The usual debayering and color space conversions are also fine. Selectively removing, adding or changing only some pixels or objects is generally not okay for journalistic purposes. Obviously, per-object AI enhancement of the type many mobile phones and social media apps apply by default don't meet such standards.
I downsized it to 170x170 pixels
My point is that there IS an experiment which would show that Samsung is doing some nonstandard processing likely involving replacement. The evidence provided is insufficient to show that
For example see
You can try to guess the location of edges to enhance them after upscaling, but it's guessing, and when the source has the detail level of a 170x170 moon photo a big proportion of the guessing will inevitably be wrong.
And in this case it would take a pretty amazing unblur to even get to the point it can start looking for those edges.
You did not link an example of upscaling, the before and after are the same size.
Unsharp filters enhance false edges on almost all images.
If you claim either one of those are wrong, you're being ridiculous.
And to be clear, everyone including Apple has been doing this since at least 2017
The problem with what Samsung was doing is that it was moon-specific detection and replacement
I zoomed in on the monitor showing that image and, guess what, again you see slapped on detail, even in the parts I explicitly clipped (made completely 100% white):
The first words I said were that Samsung probably did this
And you're right that I didn't read the dozens of edits which were added after the original post. I was basing my arguments off everything before the "conclusion section", which it seems the author understands was not actually conclusive.
I agree that the later experiments, particularly the "two moons" experiment were decisive.
Also to be clear, I know that Samsung was doing this, because as I said I worked at a competitor. At the time I did my own tests on Samsung devices because I was also working on moon related image quality
From one of the comments there:
> When people take a picture on the moon, they want a cool looking picture of the moon, and every time I have take a picture of the moon, on what is a couple of year old phone which had the best camera set up at the time, it looks awful, because the dynamic range and zoom level required is just not at all what smart phones are good at.
> Hence they solved the problem and gave you your picture of the moon. Which is what you wanted, not a scientifically accurate representation of the light being hit by the camera sensor. We had that, it is called 2010.
Where does one draw the line though? This is a kind of lying, regardless of the whole discussion about filters and photos always being an interpretation of raw sensor data and whatnot.
Again, where does one draw the line? The person taking a snapshot of the moon expects a correlation between the data captured by the sensor and whatever they end up showing their friends. What if the camera only acknowledged "ok, this user is trying to photograph the moon" and replaced ALL of the sensor data with a library image of the moon it has stored in its memory? Would this be authentic or fake? It's certainly A photo of the moon, just not a photo taken with the current camera. But the user believes it's taken with their camera.
I think this is lying.
i.e. Camera+Lens+ISO+SS+FStop+FL+TC (If present)+Filter (If present). Add focus distance if being super duper proper.
And some of that is to help at least provide the right requirements to try to recreate.
So there are levels of image processing, and it would be wrong to dump them all in the same category.
Raw data requires interpretation, no argument there.
But when AI starts making stuff up out of nowhere, it becomes a problem. Again, some degree of making up stuff is ok, but AI often crosses the line. When it diverges enough from what was captured by the sensor, it crosses firmly into "made up" territory.
https://www.theguardian.com/australia-news/2020/sep/13/pictu...
For example if you add snow to a shot with masking or generative AI. It's fake because the real life experience was not actually snowing. You can't just hallucinate a major part of the image - that counts as fake to me. A major departure from the reality of the scene. Many other types of edits don't have this property because they are mostly based on the reality of what occurred.
I think for me this comes from an intrinsic valuing of the act/craft of photography, in the physical sense. Once an image is too digitally manipulated then it's less photography and more digital art.
Even that isn't all that clear-cut. Is noise removal a local edit? It only touches some pixels, but obviously, that's a silly take.
Is automated dust removal still global? The same idea, just a bit more selective. If we let it slide, what about automated skin blemish removal? Depth map + relighting, de-hazing, or fake bokeh? I think that modern image processing techniques really blur the distinction here because many edits that would previously need to be done selectively by hand are now a "global" filter that's a single keypress away.
Intent is the defining factor, as you note, but intent is... often hazy. If you dial down the exposure to make the photo more dramatic / more sinister, you're manipulating emotions too. Yet, that kind of editing is perfectly OK in photojournalism. Adding or removing elements for dramatic effect? Not so much.
The only process in the article that involves nearby pixels is to combine R G and B (and other G) into one screen pixel. (In principle these could be mapped to subpixels.) Everything fancier than that can be reasonably called some fake cosmetic bullshit.
Raw formats usually carry "Bayer-filtered linear (well, almost linear) light in device-specific color space", not necessarily "raw unprocessed readings from the sensor array", although some vendors move it slightly more towards the latter than others.
Regarding sharpening and optical stuff, many modern camera lenses are built with the expectation that some of their optical properties will be easy to correct for in software, allowing the manufacturer to optimize for other properties.
Removing dust and blemishes entails looking at more than one pixel at a time.
Nothing in the basic processing described in the article does that.
Maybe don't bring that up, unless you want your boss to think you're a tedious blowhard.
I mean to some degree, human perception is a hallucination of reality. It is well known by magicians that if you know the small region of space that a person is focusing on, then you can totally change other areas of the scene without the person noticing.