LocalLLaMA

4 readers

4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

Optimizing Your Language Model Experience: A Student's Journey with a Cutting-Edge PC featuring Core i7 14th Gen, RTX 4070 Ti, and 32GB DDR5 RAM (alien.top)

submitted 2 years ago by Revolutionary_Fig171@alien.top to c/localllama@poweruser.forum

10 comments fedilink hide all child comments

Hello, I'm a student delving into the study of large language models. I recently acquired a new PC equipped with a Core i7 14th Gen processor, RTX 4070 Ti graphics, and 32GB DDR5 RAM. Could you kindly suggest a recommended language model for optimal performance on my machine?

you are viewing a single comment's thread
view the rest of the comments

[–] IntelligentStrain409@alien.top 1 points 2 years ago (2 children)

Go buy two rtx3090, your mid tier gpu only has 12GB vram, I see your passion, but do some research, you need more VRAM.

[–] Revolutionary_Fig171@alien.top 1 points 2 years ago

Thank you for your advice. Unfortunately, I'm unable to purchase two RTX 3090s at the moment. Firstly, my budget is fully utilized with the current components, and secondly, I doubt my system can accommodate two RTX 3090s. Considering these constraints, could you kindly provide a recommendation based on my existing setup?

[–] DarthInfinix@alien.top 1 points 2 years ago

Probably be more economical to rent a a100