this post was submitted on 17 Nov 2023
1 points (100.0% liked)
LocalLLaMA
3 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
For anyone capable of running 70b models (i.e. 48GB VRAM), you might want to check out my latest merge: sophosympatheia/xwin-stellarbright-erp-v2. It is the latest iteration of some experiments I've been conducting and I like how it performs with the provided prompt template and sampler settings on the HF page.
Sorry for the lack of more quantizations right now and full weights. I'm getting additional SSD storage next week that should help.