Selfhosted

60409 readers

504 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

Question about what to put on RAID and what to put on NVME (lemmy.world)

submitted 1 year ago* (last edited 1 year ago) by ch00f@lemmy.world to c/selfhosted@lemmy.world

51 comments fedilink hide all child comments

Since 2016, I've had a fileserver mostly just for backups. System is on 1 drive, RAID6 for files, and semi-annual cold backup.

I was playing with Photoprism, and their docs say "we recommend placing the storage folder on a local SSD drive for best performance." In this case, the storage folder holds basically everything but the pictures themselves such as the database files.

Up until now, if I lost any database files, it was just a matter of rebuilding them by re-indexing my photos or whatever, but I'm looking for something more robust since I'll have some friends/family using Pixelfed, Matrix, etc.

So my question is: Is it a valid strategy to keep database files on the SSD with some kind of nightly backup to RAID, or should I just store the whole lot on the RAID from the get go? Or does it even matter if all of these databases can fit in RAM anyway?

edit: I'm just now learning of ZFS caching which might be my answer.

you are viewing a single comment's thread
view the rest of the comments

[–] ch00f@lemmy.world 3 points 1 year ago* (last edited 1 year ago) (1 children)

I understand all of that. Sorry I didn't explain it well.

I have a RAID6 for data and a single HDD for system files. I'd like to move the HDD to an NVME/SSD. I suppose I could make another RAID with an additional NVME, but I've found it easier to deal with booting off a traditional drive.

My solution for redundancy for the NVME is to just backup the bits that I need every night. These are usually just a few hundred megabyte database files. I'm curious if that's a typical solution.

edit: to clarify, it's a software raid with mdadm.

[–] farcaller@fstab.sh 3 points 1 year ago* (last edited 1 year ago) (1 children)

I just made a mirror out of two NVMes―they got cheap enough not to bother too much with the loss of capacity. Of course, that limits what I can put there, so I use a bit of a tiered storage between my NVMe and HDD pools.

Just think in terms of data loss: are you going to be ok if you lost the data between backups? If the answer is yes, one NVMe is enough.

[–] ch00f@lemmy.world 1 points 1 year ago

Yeah, I'm only serving one timezone, so if I can swing nightly backups at periods of low activity, I'd only be out 1 day which isn't that big.