this post was submitted on 25 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
 

I use Open Hermes 2.5 7b, and I'm very happy with the performance overall. I tried to add the following context: 'Avoid using phrases like 'What can I help you with today?' or 'How can I assist you?' 'as ai' in your responses.

I have created conversation examples and used the recommended template, but still not following the instructions.

There is a way to get rid of that kind of responses? thank you in advance.

you are viewing a single comment's thread
view the rest of the comments
[–] a_beautiful_rhind@alien.top 1 points 10 months ago

This particular model might be a lost cause. You can try prompts that are more of a "character", spicier sampling or put those phrases into CFG guidance with a memory penalty.