Gyramuur

joined 1 year ago
[–] Gyramuur@alien.top 1 points 1 year ago

Not entirely, I mainly just use it as an open ended story. However, if I'm doing a second person text adventure, sometimes I will place information pertaining to the "game" and put it in memory (or system prompt, if in LM Studio), like this:

Scenario: Second person survival text adventure game set in the African savannah, hundreds of millions of years ago.

Inventory: Stone knife, dried meat, berries (4), half-filled water skin.

Current quest: Go hunting

In my experience so far, it seems to do a really good job of remembering exactly whatever's in my inventory, and if my character picks something up in game, I add it to the memory.

If you wanted more game-like systems like stats and dice rolls, I suppose you could keep track of those externally, and your rolls could be done through a site like random.org and just tell the LLM your result.

[–] Gyramuur@alien.top 1 points 1 year ago (2 children)

I'm a huge fan of MLewd-ReMM-L2-Chat-20B at the moment. I use the 6-bit quant and have found it at times to be similar in quality to the roleplays I used to have with ChatGPT 3.5 before "Open"AI nerfed it into oblivion. Hardly ever have to reroll.

 

I've seen a lot of people say that you can improve the quality of AI output by training a LORA. However, I don't have the knawledge to train one, and I don't have a lot of fiction to train it with. Is there somewhere I can go to look through LORAs that have already been trained?

Additionally, how would I use one? I know LM Studio and Oobabooga have sections where you can add a LORA, but I'd probably want to be able to use it with KoboldAI. I don't see a LORA section in KoboldAI but I do see a section for Soft Prompts. Is that the same thing?