this post was submitted on 21 Jul 2024
205 points (94.8% liked)

Selfhosted

60542 readers
523 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
ayyy@sh.itjust.works
curbstickle@anarchist.nexus
curbstickle_lw@lemmy.world
205
Why is Google takeout so bitchy? (lemmy.world)
submitted 2 years ago* (last edited 2 years ago) by gedaliyah@lemmy.world to c/selfhosted@lemmy.world
87 comments fedilink hide all child comments
 

Sorry but I can't think of another word for it right now. This is mostly just venting but also if anyone has a better way to do it I wouldn't hate to hear it.

I'm trying to set up a home server for all of our family photos. We're on our way to de-googling, and part of the impetus for the change is that our Google Drive is almost full.We have a few hundred gigs of photos between us. The problem with trying to download your data from Google is that it will only allow you to do so in a reasonable way through Google takeout. First you have to order it. Then you have to wait anywhere from a few hours to a day or two for Google to "prepare" the download. Then you have one week before the takeout "expires." That's one week to the minute from the time of the initial request.

I don't have some kind of fancy California internet, I just have normal home internet and there is just no way to download a 50gig (or 2 gig) file in one go - there are always intrruptions that require restarting the download. But if you try to download the files too many times, Google will give you another error and you have to start over and request a new takeout. Google doesn't let you download the entire archive either, you have to select each file part individually.

I can't tell you how many weeks it's been that I've tried to download all of the files before they expire, or google gives me another error.

you are viewing a single comment's thread
view the rest of the comments
[–] Darohan@lemmy.zip 8 points 2 years ago (3 children)

Just gone through this whole process myself. My god does it suck. Another thing you'll want to be aware of around Takeout with Google Photos is that the photo metadata isn't attached as EXIF like with a normal service, but rather it's given as an accompanying JSON file for each image file. I'm using Memories for Nextcloud, and it has a tool that can restore the EXIF metadata using those files, but it's not exact and now I have about 1.5k images tagged as being from this year when they're really from 2018 or before. I'm looking at writing my own tool to restore some of this metadata but it's going to be a right pain in the ass.

[–] gedaliyah@lemmy.world 7 points 2 years ago (1 children)

Wow thanks for that. I was looking into https://github.com/TheLastGimbus/GooglePhotosTakeoutHelper but I haven't gotten to that step yet

[–] Darohan@lemmy.zip 2 points 2 years ago

Ooh, might look into that instead, actually. I always love a reason to write myself a little tool, but dealing with Google's bull makes it much less appealing to me when existing tools can do it for me.

[–] seang96@spgrn.com 2 points 2 years ago

There exist tools for this from takeout archives already, its how I migrated to immich.

[–] s38b35M5@lemmy.world 2 points 2 years ago (1 children)

They also don't always keep the metadata in the same archive (zip or tar) with the pictures they belong with, and that can throw off imports with tools that process Google Takeout archives directly. Its a pretty nasty solution, for real.

I moved about 140GB to ente.io before they had their newer takeout process, but some destinations can enable third party apps (like rclone) to do cloud to cloud. Nor sure which work best, since I couldn't go that route myself.

[–] Darohan@lemmy.zip 1 points 2 years ago

Ah great, that could be why a bunch of my photos didn't get metadata. I'll look into that, thanks for the tip.