LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Are 7b models useful? (alien.top)

submitted 11 months ago by Naiw80@alien.top to c/localllama@poweruser.forum

24 comments fedilink hide all child comments

I'm struggling to get the 7b models to do something useful, obviously I'm doing something wrong as it appears many people strive for 7b models.

But myself I can not get them to follow instructions, they keep repeating stuff and occasionally they start to converse with themselves.

Does anyone have any pointers what I'm doing wrong?

you are viewing a single comment's thread
view the rest of the comments

[–] ThinkExtension2328@alien.top 1 points 11 months ago (1 children)

They generally good for single shot or low shot tasks. Eg get cliff notes , create templates . You can use vector db for informational accuracy. They struggle to keep character and context iv noticed.

[–] Naiw80@alien.top 1 points 11 months ago

Okay thanks