this post was submitted on 19 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
What kind of mobo would you put the 8x 3080s into without killing the bandwidth and creating tons of headache for yourself in getting it to work? There was a similar post here recently. Just stick to the 4090s.
emmmm, I'm not sure, all I can do is just plug them into the motherboard.
Do you have a link to the post please? I'd like to check it out.
Does your motherboard even have 8 PCIe slots? You’ll be needing server boards. Even workstation boards typically support only 7 (and can’t fit them all due to size)
Using a PCIe splitter cable, split the PCIe 4.0x16 x1 into PCIe 4.0x8 x2. And all gpu use a PCIe extension cable.
I would recommend against this, not to say you are incapable o lr wouldn't figure it out, but it's a head ache. Just the power consumption on something like this alone would drive you to a sizable power bill, not to mention lack of any kind of Nvlink, your 4090 setup is a much better option in my opinion.