this post was submitted on 24 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Are 7b models useful? (alien.top)
submitted 10 months ago by Naiw80@alien.top to c/localllama@poweruser.forum
24 comments fedilink hide all child comments
 

I'm struggling to get the 7b models to do something useful, obviously I'm doing something wrong as it appears many people strive for 7b models.

But myself I can not get them to follow instructions, they keep repeating stuff and occasionally they start to converse with themselves.

Does anyone have any pointers what I'm doing wrong?

you are viewing a single comment's thread
view the rest of the comments
[–] vatsadev@alien.top 1 points 10 months ago (6 children)

OpenHermes 2.5 is amazing from what I've seen. it can call functions, summarize text, is extremely competitive, all the works

[–] _ralph_@alien.top 1 points 10 months ago (2 children)

How does it function call? Some internal api?

[–] Shoddy_Vegetable_115@alien.top 1 points 10 months ago

It returns a JSON with function name and respective arguments which you can parse later in the program and call the function with those arguments given by the model.

load more comments (3 replies)