fadenb

joined 1 year ago

We are Higgsfield AI. We have a large GPU cluster and want to finetune your dataset. in c/localllama@poweruser.forum

[–] fadenb@alien.top 1 points 1 year ago

What do you consider "large" cluster? How many MW GPU capacity do you operate?

permalink
fedilink
source

I am going to buy H100s. There are too many options. in c/localllama@poweruser.forum

[–] fadenb@alien.top 1 points 1 year ago

Nooooo! DGX you pay for the name and "service" by Nvidia. PCIe is lacking fast interconnect with nvswitch. There is a layer in between: HGX.,it's basically DGX without the branding.

You can get such systems from Supermicro and ASUS

permalink
fedilink
source
context