Data Hoarder

1 readers

1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago

MODERATORS

communick@selfhosted.forum

16TB of data on a 36TB server, nothing backed up. Advice? (alien.top)

submitted 11 months ago by Honey_Bunches@alien.top to c/datahoarder@selfhosted.forum

4 comments fedilink hide all child comments

I'm running a plex server on a Windows 10 PC and I'm at the point where I'd like to protect myself from potential data loss. I'm using 16TB out of 36TB total.

I currently store my data on a mixture of SSDs and HDDs using Drivepool. One feature of Drivepool is that it will email me when a drive is removed. I'm very familiar with this because one of the SSDs is temperamental. It's fine for weeks/months, then disconnects randomly. Slide out the tray and slide it back it, and it works again. I would like to be in a position where one of my drives can fail/disconnect and can be addressed at my convenience while my server and its data remain accessible uninterrupted.

I can add more details regarding my setup if needed. There are definitely things I would do differently the second time around, but I'm not necessarily looking to start fresh right now. I do have a singular unused M.2 slot on the motherboard. I might want to add an NVME ssd in the future, then install Unraid OS or a Linux variant.

Any advice is greatly appreciated. Also, thoughts on moving a drivepool from one OS to another on the same system?

top 4 comments

sorted by: hot top controversial new old

[–] Hakker9@alien.top 1 points 11 months ago

Kind of pointing out the obvious here but there are 20 and 22TB drives where you can back it up to.

[–] HTWingNut@alien.top 1 points 11 months ago

Look at setting up a SnapRAID drive for data redundancy. SnapRAID needs to be as big as or bigger than your largest data drive. It works best with data that isn't deleted or changed often. And if you do, then dual parity helps a lot in that regard.

But your best option is either using Drivepool duplication feature or just backup your data periodically to some external drive or cloud.

[–] snatch1e@alien.top 1 points 11 months ago

As it was mentioned, you can implement SnapRAID for redundancy and better data availability. Since you are running your system on Windows, it might make some sense for you to use Backblaze personal as a cloud backup https://www.backblaze.com/cloud-backup/personal

Also, try to have a local backup somewhere (external drive or backup NAS)

[–] Error83_NoUserName@alien.top 1 points 11 months ago

Buy the cheapest $/TB drives you can find (still from reputable places). Give them a 1 or 2 full write cycles to check, especially when 2nd hand. And copy all the data to them. It is the easiest and cheapest solution for media or large picture libraries.

At least you have an offline copy that way. If possible store it also in a seperate building.

For documents and my very best pictures, I use OneDrive.