Google Photos is creating a deep fake of you and calling it Cinematic Memory | Hacker News Reader

Google Photos is creating a deep fake of you and calling it Cinematic Memory

22 pointswnmurphy9 comments

Last night, my partner found a new Cinematic Memory in Google Photos, called "Over the Years."

We watched it together, and in it, Google animated static photos of her over the last 5 years. It included the typical 3D field effect, but what was disturbing was that it also animated her body and her face. We watched video after video of Google making her likeness smile and turn her head towards the camera.

They have to be using facial data from her other photos to make her smile in photos where she was not originally smiling, tilt her head seductively in photos where she never did that, etc.

I assume this is a new feature that they're beta testing, because I can't find any information on it whatsoever.

They essentially created a deep fake of her, without her permission, and then made this deep fake do things that she never did.

I can't imagine what PM at Google ever thought this was a good idea for a feature. If you're productizing AI, you need to be extremely careful that you're not violating your user's personal boundaries.

Has anyone else seen this yet?

They don't need to train on your photos to make your photos do these things. It's a diffusion technique / model that can operate on any photo it hasn't seen before. I've seen many "make these people smile in the photo" apps. There is also multiple papers on turning photos into videos.

They demoed the photos history / storyboard et al during Google i/o a week or two ago. The "showing the progress of your child learning to swim" was pretty impressive because it included photos of swimming certificates along side ordering the actual swimming photos, all without needing to organize the photos manually, so there is a query/embedding aspect to it

I would agree with you, except that it knew exactly what her smile looked like. It animated a photo of her not smiling, into one of her actual smile.

The only way to get that information is from other photos of her smiling.

Have you seen image blend / target modification results? Midjourney features are just the tip of the iceberg

There is no way Google is training on every photo that it does this to. It is prohibitively expensive and not necessary to get the results you describe. They can just feed in a set of images, with one to be processed and the others as reference, to an already trained model

Google knows too much about us, and now MS is out to understand you better than yourself. I thought it couldn't get scarier with "AI" spearhead initiatives, but I was wrong

https://www.windowslatest.com/2024/05/20/microsoft-confirms-...

To answer your question directly, yes I have also seen that recently on Google photos in the US. I found it weird and useless, and you're right that it's essentially a deep fake produced by Google on our behalf without being asked to. From news reports, it looks like Google teams are desperately trying to build AI in every project: https://www.businessinsider.com/ex-googler-ai-work-driven-by...

I mean what is your problem?

Do you think Google is not analysing your pictures even when it creates highligh memories for years or has semantic search?

That's why you use it.

I can see why OP might not like this. I can also see that, at least on this site, everyone has been saying, "Stop using Google for anything," for a variety of different reasons - many of which boil down to you are the product and they can't be trusted - for about a decade now. So I'm sitting on the fence in some respects.

OTOH it's not really surprising that Google would do something with personal photos that at least some portion of their target market are going to find pretty creepy.

There was a story somewhere that a young person showed an ai version of grandpa to grandma and she loved it (or something similar).

People will like this feature.

I'm already intrigued by the post tbh.

If you haven't watched the most recent Google i/o keynote, I'd recommend checking it out. They showed a lot of intriguing capabilities

Reply on news.ycombinator.com