LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Wanna upgrade PC for LLMs (alien.top)

submitted 11 months ago by Ok_Brain_2376@alien.top to c/localllama@poweruser.forum

8 comments fedilink hide all child comments

Hey guys, thinking of upgrading my PC, I’m a dev and i wanna run my own LLMs, it’s more to run my own copilot locally instead on relying on outside services. This is what I got now

Ryzen 7 3700x 32GB RAM 5500XT

Debating whether I should get a 3950x or 5800x3D as I can game abit better as well As for the GPU I might just go for the 4090, but if this is overkill please let me know. What you guys think?

you are viewing a single comment's thread
view the rest of the comments

[–] SupplyChainNext@alien.top 1 points 11 months ago (1 children)

Meh I’m running 13bs on a 13900k 64 gb ddr5 and a 6900xt with LM studio and it’s faster than my office workstations 12900ks 3090ti. Sometimes ram and processor with decent VRM is enough.

[–] ntn8888@alien.top 1 points 11 months ago

Your comparison proves his point! 13b will fit snuggly in your 6900 this is a head on comparison of the cards!