How to Move Your Google Photos
auckland.ac.nz
auckland.ac.nz
I went through this journey a few months ago, and it's pretty hard to catch because those albums will appear in the export, and they are not empty, so you don't expect that they are partial exports. The way to export them was going one by one in the regular Google Photos app, and downloading each album as a ZIP – that way you get pictures also from other contributors to that album.
Funnily enough, I also experienced some rate limiting and had to wait a few minutes after every 6-7 albums.
My end goal was importing the Takeout into Apple Photos library locally stored on my Mac. Some other steps I had to take were:
- Fixing the metadata [0] so they showed up with a correct date
- Importing albums first, and the "Stream" (a folder per year) second, because otherwise the deduplication would mean the pictures already in the stream wouldn't get added to an album.
But be careful here. Some files will only be available at reduced quality and have all metadata stripped (even if the owner has elected to share it and it is visible in the web UI). The only way to get the original seems to be to contact the original uploader.
IIUC the only way to get the original photo is to click on each individual photo in the web app and choose to "Download original", there is no other way.
If you do use the Google Takeout approach you will need to re-stitch the JSON and EXIF back together via one of the tools mentioned elsewhere on this page.
Lesson: if you care about your photos do not _only_ use Google Photos as the place to store them, put Syncthing on your phone and sync photos directly to your laptop / NAS and treat that as the primary location.
Google Photos is a convenient viewer, nothing more.
Only those you download via Google Photos API (think: rclone) suffer from that "feature".
EDIT: I think Google Photos API "only" strips EXIF. Seen on: https://github.com/daneroo/gphotos-puppeteer
I'm fairly sure that, unless something has changed recently, this is incorrect.
Last year I went through the process of figuring out how to re-create my photos from a takeout archive. It is frustrating to a level that is almost cruel - mangled/truncated filenames, arbitrarily stripped metadata, unnecessarily ambiguous naming - but the photos themselves always seemed to be original quality.
I've recently started using the filters and tools that come with a Google One subscription and I suspect that they're not fully compatible with whatever the storage schema is that takeout is exposing. The relationship between an original image and one edited uaing the filters seems to get lost. I need to dig into this before my next semi-annual photo exfiltration is due.
Actually, I just need to stop using google photos...
A couple of years ago I exported all my photos with Takeout, because I wanted to have them locally in my LAN and back them up in BackBlaze. At the same type I set up SyncThing from my phone to my local disk to store and backup new photos and videos without going through Google Photos. But I did leave the "backup" to GPhotos option turned on.
Fast forward this year, my (legacy) Google account on which I had most of the photos/videos is now running out of space, so I first reduced the quality of uploaded photos/videos, then completely disabled the backup (I have another cloud backup anyway with Amazon Photos). And then I wanted to stop Google nag and annoy me 3 times a week with the "you almost have no more space in your account, buy Google One ASAP" thing.
First thing, I deleted some old shit/videos/attachments I had in GMail from late '00s when Dropbox wasn't a thing yet, but beside some video you quickly realize that photos back in the day were muuuuch smaller. Then I said, OK, I'm going to set a cutoff date for GPhotos and manually delete by UI all photos before 2013. I selected all of them, and put the in the "recycle bin". Then my inner sysadmin instincts came in and said: "hey, did you check that you have on disk and Backblaze those photos?".
And behold! they WERE NOT THERE!
I had the Takeout output saved as a whole (it actually comes as a zipped or targz file back in the day) and sure enough it somehow stopped around 2013. So, I went swiftly to restore the photos/videos from the bin and back to their place, and then triggered a new Google Takeout. A few hours after, I got an email saying that... IT FAILED, and that I need to retry it.
Ok... so maybe it's because I just restored the photos from the recycle bin, let's wait a few more days just to be sure. After a week or so I tried again and a few hours after, again a failure email.
This was like 2 months ago, I will try again now since I wrote already this wall of text, but, is there anybody that experienced the same? Did you find a way to get your Takeout?
You know, when Google came out with Gmail, their top comment was that 'You'd never run out of storage, ever'. That was their advertising reel.
And then, on Android, 'back up everything user-content' is turned on. And these days it's to grab as much data as possible, AND to then nag you to death with "your storage is running out".
I've got all my emails locally. I'm downloading my images, and what few files in Google docs are already copied.
Google is just a corpse being bandied around by advertisers and marketers to be made-believe as real.
I tried getting support for it via my paid Google One subscription but I just got bounced around different teams and nobody knew what to do. Ultimately they just said it can’t be fixed.
For me, it was the last straw. I bought an iPhone and I’m degoogling now. I guess to get my data out I might need to submit an GDPR data portability request, if I can find where to submit it.
The Data Accessibility modalities need to be defined in the Data Processing Agreement. So "dpa" or "data processing agreement" are also good search terms.
I still have many older albums with a lot of IMG_NNNN.JPG.json with all the metadata but NOT the actual picture. Weird. I'm pretty sure those are not albums with other contributors.
As far as backing up photos, most of you have too many photos. To make your life easier before downloading all these photos go through them with the critical eye, and ask yourself if people would be interested in seeing this photo 50 years from now.
Second, never ever ever use any cloud based back up unless you are just using it for a back up of your multiple hard drive backups. In essence, if she only be a back up of your back ups. And never a back up of your daily workflow.
In my opinion, we are heading for a time of fiscal turmoil that will either make these cloud backups too expensive or obsolete.
Storage is cheap enough that I really don't worry about paying for it, and I don't think that's going to change at my scale.
The privacy and control issues are something to worry about, though.
If you have any guiding principles based on which to answer this question, I'd love to know them.
There is one photo in existence of my great-grandfather. That makes it the most interesting photo of him by default.
There are hundreds of photos of my son. Which one(s) should be preserved so my great-grandchildren in 2123 can still see them?
I would say, keep the photos with the most context, look in the backgrounds of photos for items, and things that are interesting, not just the main subject. A photo of a person standing in a field would be much different than a person in a photo sitting inside of a house That they own.
And you are right, I think the rarity of the photos is what makes them more beautiful, more valuable.
They chatted about the weather, family, news and they made several jokes, told stories about family, and it was just this fly on the wall moment for me watching a taste of what that relationship was like. This little slice of life moment really stuck with me and I made it a point to take similar recordings on my own.
Weddings are great, but they are a performance. It is an abstraction from who people are. I enjoy a more candid style which I feel like gets tossed a lot more these days in pursuit of what we consider perfection. Storage is cheap so I keep almost everything.
Surely not every moment in your life can be as significant as that moment that your family was around the table talking about the news and the weather.
The best photo presentations I did for clients was when there were fewer photographs presented, not more.
I don't think this is true. Otherwise we wouldn't treasure photos of our great grandparents, or even of ourselves when we were babies.
Treating the two as the same problem makes things much harder, at least for me: If I know that every decision to not pick a given photo means that it’ll be permanently deleted, I end up with much larger albums than is probably reasonable for sharing with friends and family.
Storage is cheap, time spent worrying is expensive. I like being able to revisit my presentation/curation choices at a later point in time, e.g. when my audience, medium (portrait vs. landscape!), or aesthetic criteria have changed.
This is how you lose historical records, because the critical eye of the day is going to be very different in 50 years.
have a watch of https://www.youtube.com/watch?v=ZNVuIU6UUiM , which is a video of the British Library's archive. They collect published material, no matter how mundane it might seem to be, because only someone from the future looking back can tell whether it was worth preserving.
Digital data is trivial to preserve compared to physical materials! Don't delete the digital photos!
So where do you personally stop? That’s the question I was asking. It’s sort of a future fear of missing out your suffering from.
https://www.ted.com/talks/blaise_aguera_y_arcas_how_photosyn...
Around the 3:30 mark, while discussing Notre Dame Cathedral, consider how useful all those photos (and however many taken since) would be in its post-fire reconstruction.
Would anyone present at that demo in 2007 think there were too many photos, especially if they knew it would burn down?
I’m curious because in the mid 90s, I burned all my black-and-white film negatives in a rage of creativity. I felt like all my old work was dead and I was just relying on that and not creating anything new. I look back at that moment with both her and liberation so it’s hard to say whether it was good or bad.
You'd think that this should be easy to answer but it really isn't. For example, you might think that you could just search for music created prior to 1975 and that's the list of music I'd listen to. But it isn't. I can remember how insanely hard it was to get a copy of something, even in the 90s. I wanted a track by Nirvana called D7. At the time I was searching for it, it hasn't been released. I heard it on an obscure pirate radio station. I eventually found it while visiting London, inside a huge HMV store, in the ridiculously expensive imports section. The single was more expensive than two regular albums. So the actual list of music that you might reasonably hear, or hear of, and then to be able to get... It's pretty tiny.
Similarly, you might be able to get your hands on mangos, chilis and spices, but not in my old town. You'd be lucky to find peppers.
I found a jigsaw puzzle, "brands from the 70s", which has all the most popular supermarket brands you'd find in the UK & Ireland. My mother spent 10 minutes looking at the photo on the box, stabbing the various items with her finger, saying "Oooh, I remember when the packaging looked like that! And those sweets! You can't get them any more!" and off she goes, remembering some story from her childhood in the 60s... some old man who used to call into their house for a chat on his way up the road, and would have a bar of Fry's Chocolate Creme to split between 5 kids...
Don't forget car exhaust! The air here is so clean now I can smell a classic car from several hundred meters away inside my car while driving. It's hard to imagine everything smelling like that all the time.
It's worth noting that most classic cars are tuned running too rich fuel mixture - because they are driven so rarely, it's more important that the engine runs at all than that the engine is running efficiently.
Those cars smelled different - once the choke was off - wen they where new.
I think GP is right. If you look at most people's photo albums, there will be a picture and then five blurry versions of it taken seconds apart from each other. Being a bit selective often means you will be more likely to browse the album again.
As for the second, I've become lazy - going to investigate syncthing.
I've had some pretty severe data loss a few years back where I had photos on a cloud service that shut down and I was too careless to properly back them up. Once I got kids I stepped it up a notch and vowed to never let that happen again (the Glacier backup is for when my house burns down or something). Still need to write some proper instructions for my family to retrieve the data if I am unable but they're basically files on a hdd.
As for curating them, I'll leave that to the next person. I think I'd have loved to comb through pics my parents took of us. I do select pictures that are super great and add them to an album. Throwing away isn't worth the effort imo.
I try to rsync the drive to my homebuilt NAS any time I add photos. At this point I feel comfortable formatting SD cards.
The NAS is set to backup to Backblaze using restic every night at 3am.
I'd like to add one more backup into the mix, but cloud storage is expensive.
I'm now using an OWC Envoy Express Thunderbolt 3 enclosure with a 4 TB WD Black SN850X and have no issues whatsoever. Very happy with this solution!
[0] https://old.reddit.com/r/DataHoarder/comments/q8zvyt/samsung...
[1] https://old.reddit.com/r/pcmasterrace/comments/kky9g5/my_sam...
[2] https://old.reddit.com/r/DataHoarder/comments/qp4m1h/white_d...
There are other approaches, but I appreciate having the dedupe & snapshots, and I encrypt any potentially sensitive files that I send to the cloud.
This is so true. It doesn't even need to be with a super critical eye. People take multiple shots of the same subject then keep all of them. IMO if you are keeping all of them then none of them are special so delete them all. If you insist it is special but can't pick then just pick one at random and be done with it.
People are such hoarders when it comes to pictures and it means they never, ever look through them because there are far too many.
Photography is a hobby for many people. I don’t think you get to prescribe people how to spend their time (curation takes a lot of it!) and/or money on their own enjoyment as long as it doesn’t harm others.
I have two close friends, both of them quite into amateur photography. One takes about 10 times as many photos as the other and never deletes any of them, the other is quite selective in what they shoot and even more selective in what they keep; their camera roll is their curated gallery.
They sometimes have a very hard time empathizing with the other’s approach, but both seem pretty happy with their choices :)
Johnny Harris has a good video about this: https://youtu.be/GLy4VKeYxD4
Basically it's just going through your old photos every now and then and deleting everything you deem not worthy ("doesn't spark joy").
The one innovation is that your definition of "worthy" will change as time progresses, some photo might be essential to you now, but in a few years you'll go "meh" and delete it.
I'm taking pictures everywhere. At the supermarket, on the road, in the kitchen, it's more than words. All these photos are super ephemeral, they will literally expire within 30 minutes. I think it is actually correct to store low resolution copies only, as they are just enough to trigger my own memory. I would gain nothing from a RAW copy of that photo. I would lose nothing from deleting them from the archive, but it's a hassle.
My non-professional photo library is at around 50 GByte, excluding astrophotography projects and photogrammetry runs. It's a really handy size for backups, and it indexes quickly with whatever service. I'm using Google Photos as a dumping ground, but PhotoPrism also indexes quickly.
I'll also note that geotags and a correct clock matter much more for archiving than high dynamic range and raw file formats. "Real cameras" suck for easy archiving. I want to zoom into a map of places I've been, and GPS is way too flimsy to be reliable on my Canon gear.
Sorry, no, this is signing me up for too much work, never mind all my non-technical family members.
The whole point of cloud photo services is to eliminate the technical challenge of file management.
I don’t recall the script I used last time, but GitHub is pretty full of good Samaritans, eg: https://github.com/mattwilson1024/google-photos-exif
It's even GDPR compliant.
I recently went through all my Google Photos photos, downloaded everything to physical drives, and then deleted the 80% that are just redundant. I found that selecting photos in batches of months or days, making sure that each batch is less than (Thot Shalt Not Download More Than) 500 images, then downloading in google photos was more reliable than Google takeout, which had a very high rate of download failure.
On the topic of seemingly redundant files, what I got back was a bunch of useless .MP files, but a little sleuthing revealed these to be top shot motion videos. https://support.google.com/googlecamera/answer/9937175?hl=en
I guess Google has a licence issue with publishing trillions of .mp4 files, or changes their extension to .MP for some internal purpose. But the upshot is a horrible user experience, many thousands of users will be left scratching their heads before throwing these videos of cherished memories away.
Anyway, if you want to batch rename any .MP files on Windows: Navigate to their folder and enter cmd into the file path field, in the terminal rename the extensions using:
ren *.MP *.mp4
I've been wondering if the different experiences are related to the "Original Size" setting in Google Photos. I've always stored things at original size since originally using Google Photos years ago. I'm wondering if the compression they do when not using this option causes the EXIF data to only exist in the JSONs.
It seems that it doesn’t parse the GPS data anymore.
I can't imagine fighting to get my photos out of Google only to put them in something even worse.
Madness
Google Photos json files include metadata that Google may have been stripped from the original photo or video. Future You will want that metadata. Just use software that knows about those sidecars (like PhotoStructure).
Don’t downscale *anything*—the software to downscale (like Google Photos) may delete metadata (like GPS lat/lon and captured-at time) that you’ll be sad is missing later, and whatever seems to be “too many pixels” now will seem just adequate with display technology a decade from now.
Videos are enormous compared to still images, but sounds and motion can convey so much of what and how things were happening in that moment, and can be invaluable, depending on the content. New parents: take more video. It depends need to be long: 5-10 seconds is great.
Back to TFA: the suggestion to move your photos back to yet another (free?) cloud service? How does this leave you in a better place than before?
External HDDs are down to $18/tb (at least in USA, it can be a bit more elsewhere). Unless you’re regularly taking hour-long videos at 4K/60FPS, most avid photographers don’t take more than 1tb/year. My entire 25 year digital collection is < 2TB. *Keep a local backup of your originals*!
I went through the process, and Google didn’t make it easy. I wrote about it at https://brajeshwar.com/2021/how-to-delete-all-photos-and-get...
Of the three services, iCloud is by far the most cumbersome and difficult to work with.
I don't have an auckland.ac.nz Google account, but my university also suddenly changed my unlimited storage to 20GB.
There must be an upcoming hard deadline for all Google Workspace for Education admins to reduce storage usage.
https://www.auckland.ac.nz/en/students/my-tools/googlechange... explains: "Recent changes in Google’s policies worldwide mean they will no longer be providing the University and other educational institutes with free, unlimited Google Drive storage."
Anyone would have a good solution to backup iPhone/iOS files/photos to any cloud (s3, blazer, nas, etc..), NAS, or computer that just work?
I toss my phone on the wireless charger and it auto uploads them.
Best part is unlike trapping my photos in Google or Apple they are just files stored on a disk
[1] https://issuetracker.google.com/issues/112096115?pli=1 [2] https://sites.google.com/site/picasaresources/google-photos-...
These are academic accounts on Google that are granted to students only whilst they are students of the institution. The account is ephemeral and you will lose all data within the account.
Nothing is implying the students used these for personal purposes either, these could be photos of blackboards / whiteboards, photos of handouts, photos of the class, etc. Though it is likely that all photos taken are in the academic account as I doubt anyone is switching the Google Photos account and managing what's on the phone.
> These are academic accounts on Google that are granted to students only whilst they are students of the institution. The account is ephemeral and you will lose all data within the account.
Or more accurately: So far they didn't have to care, now they do, and because they can't filter down accounts more gracefully than "if too large, delete everything" (instead of just photos and drive), they tell people how to reduce the amount of data they store in the Google account.
See https://www.auckland.ac.nz/en/students/my-tools/googlechange...
This is such an absurd dark pattern to keep you spending more money on Google’s storage.
problem is i need to get 4 peoples accounts off google photo's and onto my synology drive.
My main challenge here is that I have 1.5T of photos in Google Photos and downloading them through takeout is very very cumbersome.
I am after a download manager that would help me dowload them directly to Synology, but the whole credential system from Google Photos makes it very hard to do so...
Even getting 8GB of images is stupid hard. Either you get lossy, lose EXIF, Takeout doesn't backup, etc.
And to think people have 1.5TB of data in that roach motel?
I would need something stupid simple like "copy to S3", or "make long URL path with index of links".
There appears to be a timeout on the deletion process, so trying to delete too many at a time will fail.