this post was submitted on 23 Nov 2023
1 points (100.0% liked)

LocalLLaMA

14 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
communick@poweruser.forum
1
what is the best 7b right now ? (alien.top)
submitted 2 years ago by GasBond@alien.top to c/localllama@poweruser.forum
40 comments fedilink hide all child comments
 
  1. for coding
  2. for generating stories, writing email, poems etc.
  3. good overall
  4. etc.
you are viewing a single comment's thread
view the rest of the comments
[–] Mbando@alien.top 1 points 2 years ago (1 children)

We’ve been fine-tuning models for specific applications like RAG and structured data extraction. Falcon – 7B has been really good for training. It’s both shifting to understand the target domains use of language from the training data, but also picking up instructions really well. Going to try mistral-7B soon for a comparison.

[–] ___defn@alien.top 1 points 2 years ago

Same here. Switched to Mistral a few weeks ago. The results will blow you away, the difference is remarkable.