this post was submitted on 21 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Playing around with LZLV-70b 4QM, i am having a great time with the long form responses. However after a while now i am beginning to notice "AI styled writing" I tried pumping up the temperature to 1.5, repetition penalty to 1.3 and even tried mirostat mode 1,2 on the kobold.cpp

If the repetition penalty gets too high, the AI gets nonsensical. If the temperature gets too high, the AI starts to blurt out nonsense. While I am not aiming to have the AI write exactly like a person and be undetectable, after reading it so much it's gotten pretty repetitive with it's word usage and sentences.

I've tried prompting it to

" Write in a simple easy to read way make your response more conversational and less formal. Aim to increase perplexity by varying your word choices and avoiding predictable phrases "

but it's.....limited.

any tips or methods to make the AI not be so....dry?

you are viewing a single comment's thread
view the rest of the comments
[–] edwios@alien.top 1 points 11 months ago

From my experience, give it a lot, I mean really a lot, of consistent examples in the prompt how you wish it to respond in different kinds of situations, including the tones and styles. It would work. Try to give it at least 10 to 20 examples for each scenario. Consistency is the key.