this post was submitted on 23 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
what is the best 7b right now ? (alien.top)
submitted 10 months ago by GasBond@alien.top to c/localllama@poweruser.forum
40 comments fedilink hide all child comments
 
  1. for coding
  2. for generating stories, writing email, poems etc.
  3. good overall
  4. etc.
you are viewing a single comment's thread
view the rest of the comments
[–] vasileer@alien.top 1 points 10 months ago (3 children)

Mistral OpenHermes 2.5

[–] smile_e_face@alien.top 1 points 10 months ago

Could you share your temperature and sampler settings for OpenHermes? I see it recommended all over the place, but I get only mediocre results with it in SillyTavern.

[–] Mescallan@alien.top 1 points 10 months ago

second for this. I haven't tested it for code yet, but it's very enjoyable to converse with. I find it does summaries quite well, I have asked it about a wide range of topics and it has been ~90% correct on the first response, and can kind of fall apart after going back and forth a few times, but it's only 7b.

[–] shivam2979@alien.top 1 points 10 months ago

Loved the responses from OpenHermes 2.5, however found the inference on the slower side especially when comparing it to other 7B models like Zephyr 7B or Vicuna 1.5 7B