So, I bought a nice Zotac ZBOX with 2TB local storage and 16 GB memory. Installed Debian with k3s and partitioned the disc to have a ZFS pool for the containers. I've set up the ZFS provisioner.
I'm migrating away from an RPi4 with 4GB of memory and docker-compose
I run out of memory and have my pods evicted while not having all my things migrated. Okay, I've got two new things: ArgoCD and Navidrome. But what the heck?
Now I've updated k3s according to the manual (just download the binary and restart). It wouldn't start. Ran the installer instead. During boot-up, two of my ZFS volumes got deleted by the provisioner. F*ck. Luckily no important data on there, just extra work to redo the migration. That's the second time the provisioner kissed a volume goodbye. The first time, I was to blame because I messed up a commit in my ArgoCD repo. Data was faster gone than I could say bye-bye.
I work with Kubernetes daily. K3s seemed a logical choice for managing a more significant environment. I looked into Proxmox, but docker containers are not supported.
I spent every free minute for the past 14 days migrating, but I have my doubts about the correct path. Eventually, I need a stable system.
ZFS was supposed to save me from some of those stupid mistakes. I run Btrfs so far, and snapshots are a lifesaver. Can't wrap my head around them in ZFS. Unfortunately, is the Btrfs provisioner not very widespread/stable.
Any advice or encouragement?
PS: Velero is still on the todo list... :(