this post was submitted on 23 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
what is the best 7b right now ? (alien.top)
submitted 10 months ago by GasBond@alien.top to c/localllama@poweruser.forum
40 comments fedilink hide all child comments
 
  1. for coding
  2. for generating stories, writing email, poems etc.
  3. good overall
  4. etc.
you are viewing a single comment's thread
view the rest of the comments
[–] Mbando@alien.top 1 points 10 months ago (1 children)

We’ve been fine-tuning models for specific applications like RAG and structured data extraction. Falcon – 7B has been really good for training. It’s both shifting to understand the target domains use of language from the training data, but also picking up instructions really well. Going to try mistral-7B soon for a comparison.

[–] ___defn@alien.top 1 points 10 months ago

Same here. Switched to Mistral a few weeks ago. The results will blow you away, the difference is remarkable.