this post was submitted on 30 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

I'm looking at costs for a large RAM CPU build and I want to share my ideas and get advice. I've seen others here say they've done something similar but without details.

So starting with the MB - I want a single CPU board with 12 memory channels with room for a GPU. The only one I can find is this supermicro for around $900. https://www.supermicro.com/en/products/motherboard/h13ssl-n

Gigabyte does have a 12 channel board but it has 24 DIMMs which would get in the way of a GPU. Are there other good options?

For RAM, 32gb 4800 server memory is about $140 each, so $1680 for 12, giving 384gb.

For CPU, the EPYC 9354 should be more than sufficient, and is around $3000.

top 1 comments
sorted by: hot top controversial new old
[–] simcop2387@alien.top 1 points 11 months ago

Not sure which models you'd want specificially, but take a look at Asrock Rack, they've got a lot of ATX compatible server motherboards. https://www.asrockrack.com/minisite/EPYC9004/