LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

Optimizing Your Language Model Experience: A Student's Journey with a Cutting-Edge PC featuring Core i7 14th Gen, RTX 4070 Ti, and 32GB DDR5 RAM (alien.top)

submitted 11 months ago by Revolutionary_Fig171@alien.top to c/localllama@poweruser.forum

10 comments fedilink hide all child comments

Hello, I'm a student delving into the study of large language models. I recently acquired a new PC equipped with a Core i7 14th Gen processor, RTX 4070 Ti graphics, and 32GB DDR5 RAM. Could you kindly suggest a recommended language model for optimal performance on my machine?

you are viewing a single comment's thread
view the rest of the comments

[–] IntelligentStrain409@alien.top 1 points 11 months ago (2 children)

Go buy two rtx3090, your mid tier gpu only has 12GB vram, I see your passion, but do some research, you need more VRAM.

[–] Revolutionary_Fig171@alien.top 1 points 11 months ago

Thank you for your advice. Unfortunately, I'm unable to purchase two RTX 3090s at the moment. Firstly, my budget is fully utilized with the current components, and secondly, I doubt my system can accommodate two RTX 3090s. Considering these constraints, could you kindly provide a recommendation based on my existing setup?

[–] DarthInfinix@alien.top 1 points 11 months ago

Probably be more economical to rent a a100