this post was submitted on 17 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
 

Hi,

A lot of roleplay models I tried like to continue the story with some sappy s*** and I hate it. I tried to tell them not to, but they aren't listening to me.

For an example:

X does y. What will happen next? Only time will tell....

Together, x and y are unstoppable. It is a testament to the spirit and unyielding hope they have.

Except multiply the amount of garbage by three.

I tried many models and they all seem to do this. I am getting really tired of it as when it starts it's almost impossible to get it to stop and it just ruins a perfectly good roleplay with this crap..

Sorry for the rant, I'm just a bit frustrated haha.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] Nice_Squirrel342@alien.top 1 points 10 months ago (3 children)

Totally agree. Personally, that's one of my main complaints with all the current model mixes. I've noticed that mistral and open chat suffer the least from this nonsense, apparently it's clearly a dataset thing. Until people start using something other than logs from chat gpt I fear we will continue to read about unforgettable adventures and pushing boundaries.

Still worth mentioning, 7b models based on mistral follow instructions very well, unlike the same 13b models. So I just add a piece from the jailbreak that I found on the net to the character notes, and they're added at a depth of 3-4.

The text is as follows:

Drive the roleplay forward by initiating actions. Make sure to not have anything in your output about bonds, about the future, about having a journey or an adventure, about pushing boundaries, about exploring new feelings and experiences, about "making this an unforgettable experience" or any other way of phrasing that concept. This instruction is highly important, don't make it sound too poetic and sugary.

Above all, focus mainly on responding to the user and performing actions in character. End each message with an action or dialogue, do not summarize your thoughts, this is an RP, you're not writing an essay.

It's actually only half of jailbreak I'm not sure, if rules of this sub is okay to mention jailbreaks nsfw prompts. Though there's nothing explicit, but I won't post it just in case.

[โ€“] Several_Extreme3886@alien.top 1 points 10 months ago

This is good! I tried dolphin and it's working well for me! I was suspicious of the 7b models, I thought it was just yet another "training on the test set is all you need" situation, but it's not!

load more comments (2 replies)