Selfhosted

60409 readers

504 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

Question about what to put on RAID and what to put on NVME (lemmy.world)

submitted 1 year ago* (last edited 1 year ago) by ch00f@lemmy.world to c/selfhosted@lemmy.world

51 comments fedilink hide all child comments

Since 2016, I've had a fileserver mostly just for backups. System is on 1 drive, RAID6 for files, and semi-annual cold backup.

I was playing with Photoprism, and their docs say "we recommend placing the storage folder on a local SSD drive for best performance." In this case, the storage folder holds basically everything but the pictures themselves such as the database files.

Up until now, if I lost any database files, it was just a matter of rebuilding them by re-indexing my photos or whatever, but I'm looking for something more robust since I'll have some friends/family using Pixelfed, Matrix, etc.

So my question is: Is it a valid strategy to keep database files on the SSD with some kind of nightly backup to RAID, or should I just store the whole lot on the RAID from the get go? Or does it even matter if all of these databases can fit in RAM anyway?

edit: I'm just now learning of ZFS caching which might be my answer.

you are viewing a single comment's thread
view the rest of the comments

[–] MangoPenguin@lemmy.blahaj.zone 7 points 1 year ago (2 children)

Both your RAID and NVMe data should be getting backed up daily to 2 different destinations, if it's irreplaceable.

But to answer your question, just place the DB and cache files for Photoprism on the NVMe, and the photos themselves on the RAID.

[–] ch00f@lemmy.world 1 points 1 year ago (2 children)

Can you suggest a method for two-destination daily backups that don’t involve a 3rd party service? At the moment, I’m doing every six months or so on two sets of cold storage, one offsite.

[–] MangoPenguin@lemmy.blahaj.zone 2 points 1 year ago

That sounds reasonable, although I'd be worried about not having an extra local daily backup in case files get corrupted or accidentally deleted.

[–] AtariDump@lemmy.world 1 points 1 year ago* (last edited 1 year ago) (1 children)

Take an encrypted HDD to work and leave it in your desk?

The basic concept of the 3-2-1 backup strategy is that three copies of the data are made to be protected, the copies are stored on two different types of storage media and one copy of the data is sent offsite

[–] ch00f@lemmy.world 2 points 1 year ago (1 children)

Doing that every day feels a bit impractical. I already do that every few months.

[–] AtariDump@lemmy.world 1 points 1 year ago

All a matter of your risk tolerance and how often the data changes.