LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Anyone spend a bunch of $$ on a computer for LLM and regret it? (alien.top)

submitted 1 year ago by parasocks@alien.top to c/localllama@poweruser.forum

22 comments fedilink hide all child comments

Curious if anyone got the whole rig and realize they didn't really need it etc

you are viewing a single comment's thread
view the rest of the comments

[–] Secret_Joke_2262@alien.top 1 points 1 year ago

120 thousand rubles.

I was an idiot when assembling the PC and somehow inexplicably focused on the processor when assembling the PC, and the video card is quite weak. However, after a while, I realized that this was for the better. I can use the 70B model with 1 token per second. Maybe in the future I will buy another video card so that more layers will help with data processing

3060 12 & 13600K