this post was submitted on 28 Nov 2023
1 points (100.0% liked)

Data Hoarder

1 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 10 months ago
MODERATORS
 

Example 1:
Right during the pandemic, TFI (French TV) put up all past seasons of its show 'Star Academy'. It was something I have been trying to get hold of but did not have any luck. As soon as it popped I thought I got it all. (2 years ago). Today I found out I was missing the first season (8 in total) and went to try to grab it. ALL seasons have now been removed. I am quite pissed at it!

Example 2:
A user upscaled Britney Spear music videos using AI. The results were mind blowing. I grabbed all the videos I could (official ones are 480p/720 p max limited). Less than 1 week later, the content was gone....forever.

Example 3: (Non YT)
Not YT. Koh Lanta (French equivalent of Survivor) is aired on french TV (TFI again). As soon as the season is over, they take it down. You are unable to rewatch/watch it if you missed the air/stream time. ALL past seasons are also not available and that spans to about 20+ years of contents and 30+seasons. Same applies to US Survivor but to a lesser extent. And you need to keep paying to 'stream' it.

Conclusion:
Always archive media you want to rewatch/collect. Streaming is not your friend. It is just another way of controlling content distribution, tying you up to the 'subscription' slavery model instead of owning your contents and worse, down the line downright CENSORING or MODIFYING contents to fit whatever garbage narrative is currently en vogue.

Stay focused brothers!

top 50 comments
sorted by: hot top controversial new old
[–] i-dont-exist-for-you@alien.top 1 points 9 months ago

i have (checks drive) about 4 TIB of archived youtube content, there is a non zero chance i have something you want if you like the same stuff i do lol.

Somewhere between 7-14 thousand videos. I havent checked the real number.

It's content i like mostly, with some definite deletions later on. Archived for posterity since if i don't do it nobody else will, even though unlikely to go bunk. It could happen someday :)

[–] BlazingMothMan@alien.top 1 points 9 months ago

Amen to this.

[–] HubiRo@alien.top 1 points 9 months ago

you can setup a cron job to run yt-dlp with a link to your "liked videos" playlist periodically

[–] LaGrande-Gwaz@alien.top 1 points 9 months ago

Greetings ye, I still am lamenting the long-ago deletion of that “Ed, Edd, n’ Eddy” video, in which “Nigh of Fire” is synchronized onto the film’s opening vehicle-chase; such was the means that I was formally introduced into Euro’beat. -__-

~Waz

[–] Just_Aioli_1233@alien.top 1 points 9 months ago

A reminder for people in the US who may be concerned, the same time shifting principle from this SCOTUS decision applies to saving streaming content. Simply, if you had legal access to the content at one point in time, you are allowed to time shift by recording and playing back for personal use at another point in time.

!IANAL YMMV!<

[–] subven1@alien.top 1 points 9 months ago (1 children)

You can import Youtube playlists into Jdownloader and download for example your "Liked Videos". You can also use "Google Takeout" to export all you files, playlists and history to CSV.

[–] Mountainking7@alien.top 1 points 9 months ago

You can import Youtube playlists into Jdownloader and download for example your "Liked Videos". You can also use "Google Takeout" to export all you files, playlists and history to CSV.

Yes, I use playlist in JDL. I just archived 5 french sitcoms totalling about 90-100GB of space from YT. I'm sure they will take it out at some point as it is still being played by AB channels..

[–] plunki@alien.top 1 points 9 months ago (2 children)

My yt-dlp is running most nights, but I've gotta stop... I'm never going to get around to watching everything.

Could you share the Britney Spears??? :)

[–] Mountainking7@alien.top 1 points 9 months ago (3 children)

Of course I can ... lol. I'll upload it asap. Give me 1-2 days.

edit: It was 4k upscaled

[–] sjveivdn@alien.top 1 points 9 months ago (1 children)
load more comments (1 replies)
load more comments (2 replies)
load more comments (1 replies)
[–] PanicBlitz@alien.top 1 points 9 months ago (3 children)

A really prolific chill music channel called Quantum Foam Sounds recently bit the dust, taking tons of obscure albums with unique art made by the channel with it. Fortunately the admin of the channel posted about a week earlier about what might be coming down the line, and I grabbed all the ones that were important to me (like, seriously, some of them have become things I HAVE to listen to at least once a week.)

[–] zvejas@alien.top 1 points 9 months ago

Removing content and not archiving it for others to use in the future is a war crime

[–] weeklygamingrecap@alien.top 1 points 9 months ago

Glad you were able to back up your favorites, sounds like it was a cool channel. Sad to hear about stuff like this after it was gone.

[–] Cryogenator@alien.top 1 points 9 months ago

Have you shared these on the Internet Archive or elsewhere?

[–] zvejas@alien.top 1 points 9 months ago (6 children)

or me casualty saving music I like into a playlist, revisitng it a year later

"57 tracks that are no longer available are hidden"

[–] NerdyGamerTH@alien.top 1 points 9 months ago

Japanese citypop playlists in a nutshell

[–] GolemancerVekk@alien.top 1 points 9 months ago (3 children)

I'll just leave this here: https://github.com/jmbannon/ytdl-sub

It's a tool that watches YouTube channels or playlists, downloads everything, and prepares them so they appear directly in players like Plex, Jellyfin, Kodi etc. Basically the equivalent of the *arr stack for YouTube.

[–] hogysemiv@alien.top 1 points 9 months ago

Thanks!!that's really a handy tool I will share it with my wife!

[–] Jonteponte71@alien.top 1 points 9 months ago (1 children)

And the grown up version of that is /r/tubearchivist (it also includes a plugin to sync to Jellyfin).

load more comments (1 replies)
[–] plunderah@alien.top 1 points 9 months ago (2 children)

If only it had a GUI interface for those who CBF figuring out how to configure a command line interface.

[–] gargravarr2112@alien.top 1 points 9 months ago

See comment above yours.

load more comments (1 replies)
[–] shxhsonline@alien.top 1 points 9 months ago

I feel this. Especially if you can’t remember some of the songs or mixes in the list.

[–] RedModded@alien.top 1 points 9 months ago (1 children)

You can still get them if you use a tool like Snap Downloader. Put the playlist URL into the search and it will show the URL of every video that has been removed. Search each one individually on Wayback Machine and enter the Wayback URL for that video. Works more often than not, but you have to sift through instances sometimes.

load more comments (1 replies)
[–] TastySpare@alien.top 1 points 9 months ago

This.

I learned that back in the days of "this video is not available in your country because Sony/BMG/GEMA/whoever said so."

load more comments (1 replies)
[–] FinanceFit6474@alien.top 1 points 9 months ago

They say there’s a server with everything on it. I don’t know if it’s true but I hear a lot about google just hoarding everything. I assume most of the big companies have offset archives in storage for that later day. They keep them private for reasons. Unlocking them takes skill, guidance, and friendships. You won’t get into any of those rich peoples servers without some clean tea bargaining that’s for sure. S as though some of us are crazy enough to just convince them to open up the whole thing in just a few sweet ledgers of conversation. Call it human instinct. But it’s true. We’re all just people on this world. If the ends meet, well, maybe we’ll just get all that data we’ve been asking for and get to have a drunken party afterwards! Ya know? Anyways…good luck!

[–] Goldmaster@alien.top 1 points 9 months ago

This is something I have been able to work much better on thanks to TheFrenchGhosty's Ultimate YouTube-DL Scripts Collection. It's easy to download, but hard to curate and sort as I would like playlists to be in numerical order, but it doesn't scale well if a new video is added or an order is swapped. Best stick to iso date format as that is some form of an order. I may make some tweaks to them such as better sponsorblock support and just for archival use only.

[–] ASatyros@alien.top 1 points 9 months ago

I did analysis of my liked videos, based on Google Takeout and 10% of my liked videos are gone.

On the other side I would not watch them again anyways. I just backup important stuff.

[–] bregottextrasaltat@alien.top 1 points 9 months ago

it's just such a shame that yt liked playlist got completely privated some years ago so you can't automatically download everything

[–] NyaaTell@alien.top 1 points 9 months ago

Indeed, so many videos I took for granted disappeared later. Max the storage, max the network speed... hoard everything!

[–] EpicLPer@alien.top 1 points 9 months ago (3 children)

I've set up "Tube Archivist" and don't regret it whatsoever. Automatically scans my playlists or channels I add at the times I set the cron to. It's still somewhat in early development and the cookie-parsing doesn't work half the time for me sadly, tho I seem to be one of just a few cases who have this issue.

It's a game-changer when it comes to archiving :) It even saves subtitles, comments and SponsorBlock timestamps.

[–] Jonteponte71@alien.top 1 points 9 months ago

I did as well last week. And I am in love. I’m still conservative on what I download and specifically what I subcribe to. But the process is now sooooo much easier compared to the manual labour I did before (and have for five years). Maybe my top docker app install this year!

load more comments (2 replies)
[–] Elephant789@alien.top 1 points 9 months ago

Sigh, I used to. But have run out of storage space. I'm feeling very anxious.

[–] Jonteponte71@alien.top 1 points 9 months ago

I (finally!) installed Tube Archivist last week and went through my library of already archived YT videos and saved them manually in TA (it’s the easiest way if you haven’t saved the metadata to go with the video, which I hadn’t for the oldest videos). Out of almost 1000 videos over five years or so, maybe 5% have gone private or is gone from YT. And it was mostly videos I really wanted to keep. Now comes the dirty work of trying to find the metadata for those missing videos since I do have them locally. I have done some research around how to do it, but if anyone has actually figured it out it would be nice to know!

[–] gargravarr2112@alien.top 1 points 9 months ago

I basically throw every YT video I watch into TubeArchivist. The browser extension makes this a single click. Currently have over 5TB of YT videos saved, including whole channels.

[–] rebane2001@alien.top 1 points 9 months ago (7 children)

Way too much stuff is disappearing these days, my archive has over 200k videos that have been removed from YouTube

[–] Jonteponte71@alien.top 1 points 9 months ago (1 children)

That’s impressive. Only ones that has been removed, or in total?

[–] rebane2001@alien.top 1 points 9 months ago (3 children)

Just the removed ones, the total's over a million

load more comments (3 replies)
load more comments (6 replies)
[–] xlltt@alien.top 1 points 9 months ago

A user upscaled Britney Spear music videos using AI.

Care to share ? :D

[–] jmblumenshine@alien.top 1 points 9 months ago (1 children)

I learned this one the hard way. I am an NBA fan and YouTube used to be a bastion of full games from 80 - early 2000s.

I started archiving, but then the Last Dance happened and the NBA scrubbed the Internet of all old full games.

I got half way through backing up all the 90s bulls championships before the purge and it still bugs me.

[–] Jonteponte71@alien.top 1 points 9 months ago

It’s annoying when you know they where there at some point and you just never got to them. At least they actually published som classic games on YT during the pandemic and most (all?) of them are still there. I have archived them of course :)

[–] inssein@alien.top 1 points 9 months ago (2 children)

Sooner or later all these streaming first movies and shows that had zero physical release will start to go missing or in limbo when these companies go under and people will wonder where they can find them.

I know a lot of the shows I enjoy watching on netflix will be gone someday unless I start backing them up now.

[–] Jonteponte71@alien.top 1 points 9 months ago (1 children)

That’s why I pay for some streaming services but never actually use them to watch shows. If you know what I mean? ;)

load more comments (1 replies)
load more comments (1 replies)
[–] LynchMob_Lerry@alien.top 1 points 9 months ago

I have 10-12 channels I back up. I have a windows task schedule to run YT-DLP every 12 hours on each channel and they are spaced out as much as I can so there is as little overlap as possible and the ones that do are the ones that done update regularly.

[–] DevanteWeary@alien.top 1 points 9 months ago

My thing is I just want something to watch my personal playlists/ favorites and save them so I never have that "this video was removed" problem again.

However, I don't know what can do it. I tried TubeArchivist and another one using their Docker containers in my Unraid server but it doesn't really do what I'm trying.

[–] DabuSurvivor@alien.top 1 points 9 months ago

Wow, a Koh-Lanta reference outside of r/survivor. Not something I expected.

[–] LolKek2018@alien.top 1 points 9 months ago

It's TF1 (one), not TFI :crying:

load more comments
view more: next ›