this post was submitted on 13 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
AMD vs Inel (alien.top)
submitted 1 year ago by _kinad@alien.top to c/localllama@poweruser.forum
8 comments fedilink hide all child comments
 

I'm looking to build a new PC(which I've never done, other than upgrade my current one) for running and fine tuning 7b models. I know I'll be getting dual 3090 or 4090 GPU, but I'm not sure which CPU would be best for this.

I'm wanting to take advantage of the bundle deals at my local micro center and down to these two options:

  1. AMD Ryzen 9 7900x 4.5ghz 12 core, Asus B650E-F motherboard and 65GB DDR5 for $600
  2. Intel i9 14900k 3.2ghz 24 core, MSI Z790 MAG Tomahawk motherboard and 65gb DDR5 for $800

Anyone know which would be best for my use case? I don't mind spending the extra $200, I only want the best option of the two

Thanks in advance

you are viewing a single comment's thread
view the rest of the comments
[–] llama_in_sunglasses@alien.top 1 points 11 months ago

If you're planning on running the models entirely on the GPUs, your choice of CPU won't really affect the speeds you are getting. I'd go with the Intel since this is your first PC build, I built a 7950X rig a couple months ago. I didn't have problems getting it to boot, but it absolutely had a fit over running 4 sticks of DDR5-6000 at their rated speed. The rated speed is really only valid for 2 sticks.