this post was submitted on 25 Nov 2023
2 points (100.0% liked)

Data Hoarder

1 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
 

Looking to put together my first NAS (TrueNAS). Current storage is 4TB (3x2TB SSDs) in Windows, with a 4TB and 2TB external drive. Using around 7TB total, with a view that I'll need more storage. But I'm not sure exactly how much or over what timeframe. I'm of the opinion that I'd find a use for whatever storage I have, but I don't have any plans that immediately require orders of magnitude more storage.

The SSDs are being repurposed elsewhere, but I've got 2x 4TB WD Red drives from several years ago. They seem to be in healthy condition, around 3600 power on hours, SMART data looks fine, etc. But to do anything with them, I'd have to buy more 4TB drives, which based on £/TB seems like a bad deal (approx £100 per drive, so £25/TB). My options:

  • Buy a single 4TB drive. Use 3 drives in RAIDZ1 for 8TB of storage. Total cost is £100, but doesn't leave much room to grow. Basically ruling this option out
  • Buy 2x 4TB drives. Use 4 drives in RAIDZ1 for 12TB of storage. Total cost is £200, and 5TB feels like plenty of space for the immediate future
  • Buy 3x 4TB drives. Use 5 drives in RAIDZ2 for 12TB of storage. Total cost is £300, same 5TB of storage to grow into but RAIDZ2 gives me more redundancy

Something about buying 4TB disks and paying £25/TB doesn't quite sit right with me. If I went down the RAIDZ1 route, you could argue that since I already own 2 disks, I'm paying £200 to get 12TB and therefore I'm technically getting ~£16/TB. But on balance I think I'd prefer the security of a RAIDZ2. And £300 for 12TB is still £25/TB if we look at usable storage (or £15/TB for the raw 20TB).

My other option is to ignore my 2x 4TB disks and buy all new storage. I'm not looking to buy used, and the best deal I've found is on Western Digital's website. 40% off when buying 2x 16TB WD Red Plus, which comes out to around £15/TB. So option 4:

  • Buy 4x 16TB drives. Use 4 drives in RAIDZ2 for 32TB of storage. Total cost is £1000.

Technically, the 16TB are worse value. I'm paying more than 3.3x as much and only getting 2.6x as much usable storage. But as soon as I outgrow those 4TB disks, I'll need to buy not only more drives but a HBA as well. And account for the noise, power draw and physical space so many disks would take up. Although I was looking at a Fractal Define 7 so space isn't really an issue

Future proofing is a bit of a futile task. It might take me 5 years before I outgrow 4TB disks. Or it might take me 5 months. On one hand I don't want to waste the disks I've already got. But I also don't mind spending a bit more now to get something I know will last. I was kind of hoping that by writing my thoughts down the answer would come to me, but so far it hasn't. At the end of the day, it's all subjective and there's no right answer. I guess I'm just looking to bounce ideas and hear other viewpoints

top 10 comments
sorted by: hot top controversial new old
[–] WikiBox@alien.top 1 points 11 months ago

As long as you don't know how fast your storage requirements will grow, you can't make a rational decision.

So do something temporary, until you do know.

Get one 16TB drive for your bulk storage. Use your other HDDs for backup. When the backup drives are full, get another 16TB HDD. Make a new decision later.

[–] hobbyhacker@alien.top 1 points 11 months ago (2 children)

why do you feel irresistible urge to use raid ?

[–] WikiBox@alien.top 1 points 11 months ago (1 children)

Perhaps thinks that RAID is a form of backup. It isn't...

[–] Far_Marsupial6303@alien.top 1 points 11 months ago

+1

The elephant in the room is where/what are your backups? RAID never was and never will be a backup!

[–] anonymous_lurker-@alien.top 1 points 11 months ago (1 children)

Because I want "restoring from a backup" to be my last resort in the event of a drive failure. Not my only resort.

The irreplaceable data will all be backed up separately. I'm already doing 3-2-1. But I'd much rather not have everything else get nuked in the event of a single drive failure. And I've heard enough stories of a second drive failing while rebuilding that it makes sense to at least consider RAIDZ2, especially for the larger drives.

In the case of the 4TB drives, it's a trivial amount of money for the extra drive, and in the case of 16TB drives I'd have to buy 4 drives anyway to take advantage of the discount. I don't see me needing 48TB of storage, so might as well RAIDZ2.

Using RAIDZ1 or RAIDZ2 is for largely the same reason I wouldn't buy used drives. My personal risk tolerance doesn't allow for it

[–] hobbyhacker@alien.top 1 points 11 months ago (1 children)

I consider it wasting money in this scale, not to mention the speed impact of writes. But if that makes you sleep well then do it.

Just don't update the ZFS lol. Have you heard the news about that bug?

[–] skubiszm@alien.top 1 points 11 months ago (1 children)
[–] hobbyhacker@alien.top 1 points 11 months ago

it's pinned post in this sub

[–] Malossi167@alien.top 1 points 11 months ago (1 children)

Unless you have to have your data always available a single 16TB drive will work just fine. ~£200 for the drive and it also consumes 10W and not 40. Likely pretty relevant in the long run in the UK.

And when you need more storage use Unraid or mergerFS+Snapraid on Openmediavault. They both allow you to add single drives of any size to add storage capacity and parity. ZFS is great but it kinda sucks as a home user as expansion only works well when you add 6 or even 12 drives at a time. At least for now.

[–] anonymous_lurker-@alien.top 1 points 11 months ago

~£200 for the drive and it also consumes 10W and not 40. Likely pretty relevant in the long run in the UK.

Cost was another concern, but I've not gone down that rabbit hole yet. Using the first online calculator I could find, suggests 10W will cost me 6 pence per day per drive. So about £20 per year per drive. Honestly lower than I thought and not something I'm going to be concerned about

And when you need more storage use Unraid or mergerFS+Snapraid on Openmediavault. They both allow you to add single drives of any size to add storage capacity and parity.

Thanks for the suggestion but my plan is to stick with TrueNAS

ZFS is great but it kinda sucks as a home user as expansion only works well when you add 6 or even 12 drives at a time. At least for now.

This is partly why I want to iron things out before buying. I could reasonably see a 32TB pool lasting me longer than the drives lifetime. If it somehow didn't, I'd just buy a bunch more drives and chuck them in