LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

llama2 70B from HF vs code-llama 34B (alien.top)

submitted 11 months ago by Specialist_Ice_5715@alien.top to c/localllama@poweruser.forum

4 comments fedilink hide all child comments

How come llama2 70B is so much worse than many other code-llama 34B?

I'm not talking specifically for coding questions but the 70B seems utterly stupid.. repeats nonsense patterns, starts talking of unrelated stuff and sometimes get stuck in a loop of repeating the same word. Seems utter garbage and I downloaded the official model from the meta HF.

Has anyone experienced the same? Am I doing something wrong with the 70B model?

you are viewing a single comment's thread
view the rest of the comments

[–] Paulonemillionand3@alien.top 1 points 11 months ago

worked great for me