this post was submitted on 23 Nov 2023
1 points (100.0% liked)
LocalLLaMA
3 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Can you give a example of such a model?
nous-capybara, tess
For whatever reason, I keep getting memory errors with nous, but can run yi 34b fine. No idea what is wrong.
I cannot load that one :(. Dolphin does work for me, but I cannot change the output writing style.
Sucks, all the ones I d/l work so far but I'm using exl2.
Those are actually 2 different 34b chat models but there is a merge of them, nous-tess. They were the first that came to mind. If you search 34b there are others.
I started using the Tess Yi 34b 200k the other day and it's been fantastic. Of the 34bs I've tried so far, I'm really enjoying it the most for an AI assistant. I definitely recommend toying around with it.
If you do like me and use a Vicuna instruct, make sure to put a custom stop string of ""