this post was submitted on 12 Nov 2023
3 points (80.0% liked)

Homelab

371 readers
3 users here now

Rules

founded 1 year ago
MODERATORS
 

So my KW/h rate has gone from 0.0817 to 0.1315 in the last two years. I went from paying $219 a month for electric to $450+ and I could no longer justify this and needed to take action - this is what I have done.

  • For storage I had 3-R710's with 6-4tb drives each, I moved to a new to me QNAP with 6 brand new 20tb WD Red drives and moved all of the data to that and unplugged the R710's.
  • I moved ESXi and Guests from an r630 to a new to me Dell Precision 3650.
  • I moved PFSense from an R410 to a new to me Protectli Vault micro appliance.
  • I retired the Cisco Catalyst 3560-X in favor of a new to me low power HPE 48p selectable POE switch.
  • I put my backup host (Dell Optiplex with a 4th gen i5) running Veeam on a smart switch. I have a script that shuts the computer down after the backups complete and then an hour later the smart switch powers off. The smart switch powers on the computer and I have the bios set to power on the computer after a power outage. This happens three times a week.
  • I set a group policy to set the Windows power plan to balanced from high performance for my computer and my GFs computer. This has dropped both of our computers from using 150w+ to 20-30w at idle. Identical computers 11900k/3080ti EVGA FTW3
  • My torrent host is another Dell Optiplex with a 10th gen i5, I have that set to Windows power saver mode and max 45% CPU / min 0%, it uses less than 1w at idle now.
  • I recently install a whole home energy monitor into my main panel and integrated it into HomeAssistant so I can log and monitor. (see imgur picture)
  • On top of all of this I have set my water heater from 145F to 135F, unplugged unused devices in unused rooms too.

I am happy to say my mini production environment is now running stronger and cooler, the ambient air temp in the basement has dropped from 86F to 70F. The best part of this is I just got my latest energy bill. I went from $510 last month to $270 this month! Nothing else has changed other than what I have posted here today.

Check out this screenshot of the energy monitor, with both gaming desktops, both fans, and all the basement lights and TV/AV receiver powered right now, I am only using 600ish watts! Before that I was using over 2.5kw/h
https://imgur.com/a/uqblvyw

top 50 comments
sorted by: hot top controversial new old
[–] CameronDev@programming.dev 1 points 1 year ago

That is an insane power bill even after your cuts. Do you have the option of solar? With your power usage you should pay it off super fast when your bills drop to near zero?

i am paying about 20 usd for that rating for 3 months prices are crazy in us

[–] DecideUK@alien.top 1 points 1 year ago

Nice work.

Jealous of your 0.1315 😂

[–] chin_waghing@alien.top 1 points 1 year ago

That's impressive.

I'm crying in .35p/kwh ($0.43)

[–] dopeytree@alien.top 1 points 1 year ago

I'm confused. How much was your idle draw before in total?

[–] phidauex@alien.top 1 points 1 year ago

Nice work! Studies have shown many times that visibility into ones energy usage is the most helpful tool in reducing energy usage. You can't adjust effectively if you have to wait a month to see the results, being able to monitor energy live lets you make realtime tweaks to see what works.

My homelab has been running at about 90W for a long time, but had gotten up to 150W after adding an HPE ML30 and a new switch. I'm now about to retire one host (should have an Optiplex 3060 Micro for sale soon...), combining two POE switches, and hoping to get back down to at least 100W.

[–] hifidood@alien.top 1 points 1 year ago (1 children)

It's crazy how cheap power is some places. Paying upwards of $0.42 USD a Kwh here in Southern California.

[–] SamSausages@alien.top 1 points 1 year ago

and a big part of the reason is taxes and regulations. People with $$ don’t care, but everyone in the bottom 75% really takes a big hit compared to their income.

[–] Awkward_Underdog@alien.top 1 points 1 year ago (2 children)

Can you give more info on your energy monitor device? How does that work and what is it called?

load more comments (2 replies)
[–] FraggedYourMom@alien.top 1 points 1 year ago (1 children)

Don't turn off the smart switch! Power cycle when you want the machine to boot. Killing all power will drain your CMOS battery faster because there is no standby power. Last thing you want is finding out your backups failed or drives got corrupted because it was no longer booting to the OS and getting a hard shutdown repeatedly.

load more comments (1 replies)
[–] Fruguy01@alien.top 1 points 1 year ago

What's that HPE switch model?

I'm running a Cisco 2960X atm and an Aruba 2930F JL258A currently.

I also have 2 Cisco WS-C3560CX-8PC-S and 3 C1000-8FP-2G-S switches I can swap things out for.

Waiting for "winter" to get here in the south so I can run some ethernet cable through the attic to a few places and finally mount my network rack on the wall.

[–] Mind_Matters_Most@alien.top 1 points 1 year ago (5 children)

This should be a pinned post for Homelab for others who are looking to pickup Enterprise servers for home use.

People do not realize the power consumption, cooling requirements and the noise levels enterprise servers take to run.

[–] gckless@alien.top 1 points 1 year ago

Too true. I haven't turned on my R720 in over a year because of all that.

But I will say that anyone that actually wants to play with the PowerEdge stuff should look at the R2X0. I have an R230 that idles at around 40W with a couple simple VMs running. Nice way to still get the iDRAC/enterprise experience while staying relatively low power.

No, everyone needs a Colo datacenter's worth of hardware in their moist basement

[–] ThreeLeggedChimp@alien.top 1 points 1 year ago

Nah, OP just has ancient garbage.

Those 10th gen servers are over 10 years old.

[–] katatondzsentri@alien.top 1 points 1 year ago

And this is exactly what keeps me from doing that. RN I'm running a mix of raspberry pis and a beefed up desktop pc, planning the next version, which will most probably be a series of orange pis in a cluster.

I don't have a usecase for virtualization though, I'm running a shitload of containers.

[–] gearfuze@alien.top 1 points 1 year ago

I would also add that people add multiple enterprise servers/computers for virtualization when they only need a single device. Make that single server sweat lol.

[–] sintheticgaming@alien.top 1 points 1 year ago

Damn I feel spoiled I pay 12.4384¢ per kWh where I live.

Edit: Actually I just check apparently it went up to 14.69¢ per kWh 😂

[–] PancakeWaffles5@alien.top 1 points 1 year ago

Cries in PG&E Time of Use pricing at $0.32 (winter low) to $0.54 (summer high) per KWh

[–] plasmaticD@alien.top 1 points 1 year ago

$.08+ /kwh USD here, and I still opted for the lowest powered 24x7 network gear feasible. Once I calculated cost/watt/year, the economics of doing lower power became real even for lower costs like mine.

Good choices, OP!!!

[–] jllauser@alien.top 1 points 1 year ago

I’d love to still be paying $0.13/kWh. I’m hovering around $0.20 now. My community solar farm offsets this a bit, but it’s still up a ton.

[–] Ordinary-Mistake-279@alien.top 1 points 1 year ago (1 children)

bought an used hp proliant dl380 gen9 with 128GB ECC RAM and 2xE-5 2650v3 xeon 2x500W power supplies... just to test installed ubuntu got powertop, set acpi devices to autotune, modded the ilo for fan adjustment and i am at 55W in idle.

before i have had a self made ryzen "server" with Ryzen 3700x 32GB RAM and a Nvidia GTX 1080 sitting at 130W Idle....

thats what i have to say for industrial servers ;-)

[–] ThreeLeggedChimp@alien.top 1 points 1 year ago (1 children)

Why not get a v4 CPU?

I got mine for $5 each

2 core's more and a bit more cache... idk i've that's worth it. 40 threads are more then enough for my use cases. and if not, i would rather ugrade to >266X CPU instead of switching an v3 to an v4.

[–] red_dog007@alien.top 1 points 1 year ago (1 children)

Why not virutalize pfsense and that torrent box? An extra 2 computers unplugged.

[–] WhatAGoodDoggy@alien.top 1 points 1 year ago

Personally I wouldn't want to virtualize pfSense. It needs to be it's own piece of hardware so it isn't affected if you need to take the main server down.

Thank you for saving Earth

[–] Prize_Relative_9863@alien.top 1 points 1 year ago

How can I save on electricity?

[–] oasuke@alien.top 1 points 1 year ago

There's always a trade off between performance and saving electricity. You cannot have both

[–] xardoniak@alien.top 1 points 1 year ago (1 children)

One of the best things I did for my homelab is swap from 2 120w Xeon servers to a single Intel 12400 machine. Went from $4-5 of power a day to $1-$1.50.

As in an i5-12400? Which xeons did you retire? I am smacking myself as I’m one of the newbs that went with an r630 lmao but probably could have gotten away with something smaller, newer, and more powerful. Though I do like the drive space and pcis

[–] encryptedadmin@alien.top 1 points 1 year ago

I cant believe paying that much money for electric bill. I use a laptop with broken screen and keyboard for Proxmox even tho I have a poweredge r210ii. Power consumption is around 7 watts with one usb external drive to the laptop. Only have 2 VMs on proxmox.

[–] BigSmols@alien.top 1 points 1 year ago

I get the impression you spent 2,5k to do this, how much'd this cost?

[–] mpking828@alien.top 1 points 1 year ago (1 children)

Serious question.

Why didn't you bring the hot water heater down to 120?

Usually the mixing valve is required to be at 120 or below, so keeping the tank hotter won't be noticed

load more comments (1 replies)
[–] user3872465@alien.top 1 points 1 year ago (1 children)

Lol that same bill would slap me with a 1.3kEuro/A bill lol at 40ct/kwh

I am paying the same 270 for my 60W lab.

Great talking points tho. Power is always somethign to considder whenever I see someone getting a big enterprise server.

[–] bob256k@alien.top 1 points 1 year ago

Ughh what??? 270 euro for a 60w lab? How does having lights work if your bill is so high? Y’all just be rationing the lights, turn them on and memorize where everything at ,then walk in the dark 🙃 ?

I’m not hating and I of course want to conserve energy and save the environment but that just seems evil to charge that much for such a small draw. You could literally run that off a solar panel and ups independent of the grid.

[–] ripnetuk@alien.top 1 points 1 year ago (1 children)

I have been on a similar quest. I've gone from 500w to 50w over the last few years, starting with 2 r710s pimped out to the max, to a flash only white box athlon build. Slightly miss idrac, but a decent trade for it being 50w and so quiet I can only tell it's on by the LEDs.

[–] Klutzy-Residen@alien.top 1 points 1 year ago (1 children)

Look into PiKVM. Costs a bit to build, but may be worth it.

load more comments (1 replies)
[–] xdamm777@alien.top 1 points 1 year ago

This is why I disable turbo boost on all my Intel machines that don’t actually NEED single core performance.

My most used laptop is a 2019 16” i9 MacBook Pro that gets loud and hot as hell on the default power plan but simply limiting the CPU to 99% makes it whisper quiet, cool and it can run on an 18w iPad power brick with the as long as the brightness isn’t maxed out and I’m not stressing the Radeon 5500M GPU.

Same with my 10w micro Optiplex AD/MSSQL server; the old 4th gen i5 runs Windows server 2022 plenty fast and boot times are insanely quick. Sure, if it had a production database serving thousands of clients at a time then it would definitely crumble but I don’t need more power for a local AD/dev-staging db.

[–] nightmareFluffy@alien.top 1 points 1 year ago

What I did, which probably applies to almost nobody: Downgraded my home servers to a single Beelink Mini PC; still gets the job done, though it is slower. Offloaded a bunch of stuff, including backups and video stuff, to my much more powerful work server and NAS. My work has a lease with electricity included. (It's my business, so I'm not doing anything fishy.) Old hardware is sitting unused. The one downside to this is that my older setup was using ~20% CPU all the time, whereas the new one uses like ~60% and goes to 100% at peaks. I don't notice it in practice.

Also, I added solar panels to my house. So even if I were paying for my older setup, it would've been covered.

[–] -eschguy-@alien.top 1 points 1 year ago

What route did you go for energy monitoring?

[–] throwdroptwo@alien.top 1 points 1 year ago

All these changes were in the name of almost reducing up to $250 a month on the electric bill.

How long till you see a return on this investment?

3 years? 6 years? 20 years? Yea that is the essence of door-to-door solar panel install scams.

[–] djgizmo@alien.top 1 points 1 year ago

What region of the world?

[–] cylemmulo@alien.top 1 points 1 year ago

This is the way. As cool as enterprise servers are it’s nice to have a setup where my servers are 1/10th the size, and power consumption, as well as have more compute.

[–] Hairless_Human@alien.top 1 points 1 year ago

Jeez you guys are paying so much for power! I pay $0.10 kwh so power costs for me is of no concern. I just let my servers sip away.

[–] Beetanz@alien.top 1 points 1 year ago

I just built an off grid solar array. But I’m already utilizing mostly low power/ consumer equipment. Reducing the number of hosts would hurt uptime though.

[–] SocietyTomorrow@alien.top 1 points 1 year ago

It’s okay…. I still have 4 r910s that my deepest pleas for upgrades remain unheard to this day.

[–] SkipTam@alien.top 1 points 1 year ago

I had 2x R710 couple years back. I downgraded to a Ryzen self built system when my Price went from 26c kw/h to 32c kw/h. Now i "Downgraded" (Feels more like an upgrade) again to a Lenovo mini PC because my price went up top 40c kw/h. It sips 7w idle and up to 30w when transcoding. Those things are grad. I'm thinking of getting a couple more and running them as a hyperconverged cluster. Sad times nowadays how expensive everything is getting.

You know in Europe (Belgium) elektricity is 0.3$/kWh ? You still are one of the lucky ones I guess...

load more comments
view more: next ›