It's worth the hassle. If you are obsessed with power consumption, consider the fact that Pis are very power inefficient. They draw less but also produce way less than other CPUs. Performance per Watt is shit. They were conceived as thinkerware. They are not reliable the way everyone here wants them to be.
Just to put your puny power concerns into perspective. My homelab draws around 130w on average. One big box with lots of HDDs, 2 Lenovo Tinies, networking.
My laptop draws more power in 24h than my homelab. If you have a desktop, the discrepancy is even bigger. Nearly anything in your household blows your setup out of the water. I live in a country with relatively high power costs and I can assure you, your concerns are nothing more than a thought experiment.
I would get the N100, get 2x2TB SSD as well as some smaller SSDs for VM and LXC storage. Create a hypervisor with the appliances you need - NAS, Docker, heck if the board has a free PCIe slot you can put a 4x1GbE NIC and spin up a networking VM too. This way you can streamline the maintenance - updates, backups, etc. And the best part is that this single box will be waaay above anything you have now.
I can't speak about AMD but here is a rundown for Intel CPUs.
These are the 3 tiers that I look at. Metor Lake is about to be released with native encode and decode support for AV1 but it's too early to matter.
More info in the chart here.