this post was submitted on 17 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Hi,

A lot of roleplay models I tried like to continue the story with some sappy s*** and I hate it. I tried to tell them not to, but they aren't listening to me.

For an example:

X does y. What will happen next? Only time will tell....

Together, x and y are unstoppable. It is a testament to the spirit and unyielding hope they have.

Except multiply the amount of garbage by three.

I tried many models and they all seem to do this. I am getting really tired of it as when it starts it's almost impossible to get it to stop and it just ruins a perfectly good roleplay with this crap..

Sorry for the rant, I'm just a bit frustrated haha.

you are viewing a single comment's thread
view the rest of the comments
[–] sophosympatheia@alien.top 1 points 1 year ago

For anyone capable of running 70b models (i.e. 48GB VRAM), you might want to check out my latest merge: sophosympatheia/xwin-stellarbright-erp-v2. It is the latest iteration of some experiments I've been conducting and I like how it performs with the provided prompt template and sampler settings on the HF page.

Sorry for the lack of more quantizations right now and full weights. I'm getting additional SSD storage next week that should help.