nexusjuan

joined 10 months ago

China is retrofitting consumer RTX4090s with 2 slot blower for ML in c/localllama@poweruser.forum

[–] nexusjuan@alien.top 1 points 10 months ago (1 children)

I'm running a Tesla M40 12gb and I'm real close to pulling the trigger on a 24gb. I also have one of the Tesla P4's in my server. With the the M40 I can fully off load 13b models to vram.

permalink
fedilink
source

What do you ask for from Santa? in c/homelab@selfhosted.forum

[–] nexusjuan@alien.top 1 points 10 months ago

I've reached the age where I buy myself something special for Christmas like I do everyone else on my list. This is how I make sure I get what I want for Christmas.

permalink
fedilink
source