Keegan – Personal photo coach
keegan.regaind.io
keegan.regaind.io
Uploaded the second picture of this fantastic set by a 1950's photographer from Hong Kong: http://designyoutrust.com/2016/02/hong-kong-in-the-1950s-cap...
Many of them get labeled as #badcolors or #boring, I guess it might be related to the lack of color features...
See for instance their demo here : https://regaind.io/demo/.
Generally I feel tempted to file this site under fun with phrase generators, with some ML thrown in to make it slightly more interesting than purely random phrase generator toys. But are there really no use cases for automated checks of aesthetic conventions? Sifting through the data dump of a full day of wedding shots maybe? I know I would be tempted to start with a computer generated shortlist. Mate it with face detection so that you can cluster by subset of attendees (each combination of faces captured must be present at least once in the final set) and... well I guess they already use systems like that, it's 2016.
An entirely unrelated idea in the general area of photography, algorithms and human learning that I still miss is this: an option in manual mode that takes a full auto shot right after the manual one, exposing how good or bad the algorithms are vs the operator. Or do some cameras have something like that? Do manufacturers omit it to not expose deficiencies in their algorithms? Do they omit it to not hurt the feelings of customers when they are worse than auto mode?
I think it basically looks to see if something is in focus, and you know the "rule of thirds", which it must have learned from custom-cropped photos uploaded to 500px.
https://keegan.regaind.io/p/04t9ZlbZRDqbc2mPx-4CvA
Does the system have a notion of how sure it is of the rating it gives? [Edit: should it say "without a doubt"? There should be some doubt.]
(Also, is it deterministic (same image always get the same rating); it sure appears to be and it's certainly what people expect of a bot, but that's not how humans rate things...)
https://keegan.regaind.io/p/BRINmnczQ-yY7wLn0xbaYA
but says that The background really adds something special. The background is... full black?
And it hates this image (4.7):
https://keegan.regaind.io/p/nWu-YSRgSrWWfwxUgUorcQ
and gives it a "good timing" of 35%. The timing is what makes this photograph ;-)
Also, while direct links work, the back button doesn't seem to update the content of the page?
What's your browser? (re: back button problem)
one quick question - the page you linked starts with a top picture and then a set, by "the second picture of this fantastic set" did you mean the second picture on the page (gondolier in dark canal with tight ray of light from above) or second in the "set" (guy crossing tracks running with empty rickshaw)
"Overall, this image is good, but it could be great." https://keegan.regaind.io/p/whFZsOsRRfG4sRBGCDiA7g
"The blur and the subject together, so good. " https://keegan.regaind.io/p/HopS2XrnSmGhXiMg6AFoLA
"This is a solid image." https://keegan.regaind.io/p/USKPgJgfRE-h_n7rh2QnHg
"So simple, but so good" https://keegan.regaind.io/p/xbQHksWyRsOPWhW3hhs6RA
Don't get me wrong, I think this is pretty cool, but there is no real actionable feedback, so there unless you can guess as to what triggers the higher scores, there isn't much coaching, so much as "gaming" the AI.
My bias as an Asian American: I translate a 7.4 to a 74/100 to a C, which is not a good grade, hence a desire to see coaching to achieve a score of 9.8 and above.
https://keegan.regaind.io/p/sqs8Z8RgSsuaSG3gLxo0bQ
https://keegan.regaind.io/p/dNMYqs3aSpa_x0fYMU_AhA
I'm not really seeing it couching me though:
https://keegan.regaind.io/p/6QD0ycG3QTK1uM2IbIslSw
"This landscape is good, but could be great". Not really sure what to do with that.
https://keegan.regaind.io/p/lhCz67aBTnmI5GB9sWO4cQ
Seems like a low score. Again though, it's not really clear why. "Bad lighting" seems odd, because maybe I have no taste but the lighting is the reason for the shot in the first place. For reference, here's the original: https://www.flickr.com/photos/stefandufresne/16091643487/in/...
So far, AFAICT, it is a big fan of single focus thing in foreground with lots of blur in the background.
Edit: I'm having trouble getting it to ever like black and white shots: https://keegan.regaind.io/p/-NZR7e1FTJGtpMN3BPYlAg
Edit 2: Okay whaaaaaaatttt I'm really disagreeing with a lot here. Maybe I just think some of my shots are better than they really are, but 4.1 for this is crazy https://keegan.regaind.io/p/y3LaI_J0R6a33eJ_fOQfew
Didn't try B&W yet, don't have many pictures like that.
https://keegan.regaind.io/p/YLzqGGvuSFOv7PwLl8qC8A
Same image with clarity upped to 100% (horrible, IMHO), 8.6:
Once upon a time, in certain newbie photo critique forums, pranksters would upload a renowned photographers image for critique... Hilarious feedback from new photographers showing off their critiquing prowess.
Weird to imply such a strict delineation between photography and art.
The humor is from imagining a robot pan great works because of implementation flaws. "Mona Lisa. Muddy and drab. 2/10"
Nothing really to do with me trying to classify what is/isn't art.
What you might call conceptual photography, on the other hand, is "AI-complete". It's as hard as literature to appreciate, you definitely need a full human-equivalent AI. Roland Barthes' ideas of the studium and the punctum start to open up the intellectual depth of that kind of photo.
This kind of project is possibly credible as a rater of formal quality against some ideal norm, maybe stretching to understanding composition in a crude sense. But everyone knows that it's the unexpected but visually compelling feature that makes an image good. (Or alternatively the significance of its content.) Standard strategies like the "rule of thirds" can only produce formulaic images.
"It's not super amazing. It's…something I guess; you could do better. Try improving your colors. This is at most 3.9/10. #boring"
Yeah, Henri, improve your colors you lazy hack! ;)
and Autio: https://keegan.regaind.io/p/qzqjM1CPRxGtkL1GQ4KL0g
But I get it. It's a great tool for beginners to see their rookie faults and address the basics [1]before they can foray into more intermediate photography. And then break the basics [2] in order to know why breaking the rules work and sometimes don't.
Semi-related (to the optics/mechanics) is this tool[3]
[1]https://www.flickr.com/photos/msc72/3184463442
Side note: Is this bot on Facebook Messenger as well? Or did I misunderstand?
1) It utterly fails as a coaching tool. "Your framing is 71% correct". Great. Awesome. That's maybe technically correct (the best kind!), but it's utterly unhelpful.
2) It fails at images taken to capture a mood instead of a motif. (Exactly what I'd expect from ML :)
3) It has problems with things that we usually consider iconic photos. Annie Leibovitz's picture of Mick Jagger in an elevator? Meh, 5.2. Dorothea Lange's "Migrant Mother" gets at least a 7.6, so on par with my vacation selfies.
It's a great idea. It needs a lot of love.
1) as I mentioned elsewhere, the explicit coaching happens when you submit a photo that Keegan think is bad (say score < 5).
2) Mostly true, except that it's surprisingly good at capturing the notion of good timing, which I did not expect from ML ^^
3) well, as for the Mick Jagger picture, I can see why Keegan dislikes it: it's simply not that good technically. What makes it great is that it's Mick Jagger and that he has a very deep sight (imho), which the model indeed does not capture. For the other picture, yeah, the score is not that good, but the comment is spot on (in my humble and very biased opinion) :p
Thanks for the feedback, and yeah, definitely needs more love before it's a perfect predictor! Nicely enough, classification tasks with tons of supervision still make a lot of errors too ^^ (http://pbs.twimg.com/media/CdOxQRbWAAEUZM6.jpg)
I do wonder if it's a bit sycophantic, after all who wants to be told they're terrible all the time.
That being said, it's fun to see where photos fall in its grading system, even if I personally disagree with it.
For example, this portrait by Vivian Maier gets a 4.2 https://keegan.regaind.io/p/9VJdlageRTusSf7Z2qDQPA
Subject well framed: 100% Super sharp subject: 71% Great composition: 68% Pleasant blur: 57% Great lightning: 35% Well chosen background: 33% Interesting/original subject: 32% Good timing: 26%
So it's not very happy with half the categories but scores 9.4/10, so the score is definitely not an unweighted mean! (geometric or arithmetic).
"Well done!"
How the heck is this feedback supposed to be useful / helpful / actionable?
...This photo is alright! I give you a 7.1/10. That's a very decent photo for a start! Can you show me something even better?
Sometimes you can make opportunity "happen" through equipment with more reach or foreknolwedge. But sometimes things just happen and a mediocre shot is more powerful than none at all.
9.8, from France. https://keegan.regaind.io/p/xbQHksWyRsOPWhW3hhs6RA
Not really a coach though. More of a critic.
On the other hand, it doesn't like the lighting or colors on this, and wants more bokeh. I'm willing to grant that the composition is dull, but the colors? https://keegan.regaind.io/p/pQ9U6CiMRKWNkYVgqLZTCQ
And again it complains about lighting, which is probably the last thing I would worry about on this one: https://keegan.regaind.io/p/-CC6phAPScux1CSYPqY24Q
And this one has the same light, and cleaner composition, but it still complains- I'm not sure what it thinks would improve it. "Bad composition" is not helpful advice here. https://keegan.regaind.io/p/6T6V3k8fRLSWMn2JT6-N4g
Meanwhile, it's weirdly positive about this digital monstrosity: https://keegan.regaind.io/p/Csyd3O6pRg6vra2hqumKOQ
For example, this kind of generic picture of my son during the fall got an 8.2: http://imgur.com/a/SOFE0
Where as this other picture I took, one I think is technically superior recently got a 7.1: http://imgur.com/a/VeEL9
And then there was this one I took in Rome, which got a comment of "not enough blur" which is the exact opposite of what I wanted. This is a fiat in rome, the background is the entire point. rated at 6.2 http://imgur.com/a/zLStt
Compared to this pretty generic musuem pic... that's not really interesting in any way, but managed to get an 8.2 (probably because of the blur) http://imgur.com/a/Szc9I
1) I consider this photo mediocre. Gets a 10/10, Platinum Ribbon. https://keegan.regaind.io/p/lJ7FEb1kQt-mM1kIe-kVuw
2) I consider this photo to be fantastic. Perfect reflection. Gets a 7.7/10, no ribbons. https://keegan.regaind.io/p/KUzvRfFeRsK1Lj1selLWQw
3) I consider this photo good but not great. Okay but not perfect reflection. Gets an 8.7/10, Reflection Ribbon. https://keegan.regaind.io/p/zaRlMOEySFWKTZlSvWO3Rw
This is confusing as hell to me. I'm averaging 7.98/10 over 30 photos, which personally I think is too high. I'm not that good. But at the same time, my best photos are rated very low and my mediocre photos are rated very highly. This makes no sense.
This photo gets a 6.2/10 and is rated negatively for composition, but is actually near perfect (if I'd have a wider angle lens it might have been better). It follows the rule of 3s with reinforcing repetition throughout, including even in the perfectly captured reflections of me taking the photo itself. It's not an /interesting/ photo, but it's practically perfect composition. https://keegan.regaind.io/p/hrbE85wGQWW3vs5w1QoGFg
Keegan is weird.
Overall aesthetics is a very subjective subject, and getting perfectly accurate scores for it on the wide variety of photos out there is still an open challenge :)
- Can't add pictures to the hall of fame after the fact.
- Can't remove pictures from the hall of fame.
- Re-uploading a ribbon picture doesn't work.
Thanks for the report tho, I'll see what we can do for reenabling the hall of fame button after the first show!
"Your colors are flat. OK image. You could improve your colors. This deserves a 5.5/10. Not bad, but I'm sure you can do better!"
Static composition, my eyes don't really know where to look and the pic is not very exciting… It's flawed, but you'll get there: keep working on your composition and lighting. This is at most 3.8/10. #messy#boring
Here is the photo http://www.fubiz.net/wp-content/uploads/2015/07/stephenshore...
But honest question: Is that a good picture? I don't assume that the AI is trained enough to give accurate critique on all photos, but in this case I might agree with it.
I'm not trolling nor mean any offense, but is there quantifiable skill behind that photo, or is it just as subjective as painted art? A simple example would be a Pollock painting which I don't care for at all.
You might also dislike Pollock not only for being boring but for being associated with a tedious CIA-sponsored moment in art in the 50s, in which case I applaud you.
I'm sure there's some historical context or something I'm missing out on here, but that's just my take looking at the picture.
Shore has a good "eye", which is something subjective that needs training to develop and recognize. It's very plausible that the particularity of a given artist's "eye" will be quantifiable by AI systems soon.
Shore wrote a popular book called "The Nature of Photographs". Recommended.
Many people seem to think that photography is solely documentary, but that is only one possible aspect. You also have control over what is in and out of the picture, where objects are relative to each other, the relative tones and brightness of objects, etc., and can use that to tell a story that's not strictly true. If you've ever been composing a shot, noticed that there is a big pile of garbage in the frame, and shifted the angle slightly, you're already doing this.
I would be interested to see a Turing test with this tool versus a real photographer analysis.
Restrict the "analysis" to 3 or 4 sentences along with a score. The participant goal would be to figure out which analysis came from the AI and which came from the photographer. Would be interesting to see the results...
Are you working on more than classification? What about automatic improvements, including not just lightning but also straightening, cropping, etc.
You can have a look at your webpage for all that we do (https://regaind.io), but yeah, automatic improvement is on the list of potential things we would like to do :)
Don't know how to do those setting changes on my phone :-) I just posted a selfie on Bart... Bart lighting isn't too flattering
He seems to like it. 6.5/10 for a generic, raunchy shot.
The point is that pornography is probably the least-composed imaging one can find. It feels like this bot is just spitting out random compliments.
[0] https://imgur.com/a/s5vdh [NSFW, obvioulsy]
Actually, the score scaling is a very tough subject for a public thing. We received some comments saying that Keegan is wayy too harsh, it seems people expect their everyday picture to score 7-8 (we've been told it'd be a big problem in the US especially, I can't judge on that as not living there tho :/), while we feel that Keegan s generally a bit too generous for Europe standards.
I might be a particularly tough sell since I grew up in the US but have been living in Europe for quite some time now ;)
I think what you're seeing on is AI hype in action. The marketing of Keegan suggests that it's AI should be capturing some of what is usually perceived as subjective taste (e.g. whether or not the image is "interesting"). This ends up disappointing because the AI (which is clearly an incredible technical feat) is really just capturing objective elements of composition.
Perhaps you just need to fine-tune the language so as to do some expectation management?
A photo of a street sign is definitely a photo ;-)