this post was submitted on 24 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Unquantized, 34B models require at least 65GB plus extra depending on context. I cannot see how your comparison of alternatives can work.
You would need 3 x 4090 to run the model.