this post was submitted on 10 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
 

So, a couple years ago, i found something called AI dungeon, it was my first contact with an AI model. It was very good until it got censored af. The version i used was probably using GPT 2 or 1 (idk)

Is there any model that can compare or is better for text based RPGS that isn't very censored and preferably 7b (im running on oobagooba with my CPU)

Note: Sorry if i used the wrong terminology, I'm still a total noob lol. I discovered you can run your own language model just 2 days ago, and don't worry, I'm not trying to fulfill some weird fetish ๐Ÿ’€.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] rainbowkarin@alien.top 1 points 10 months ago (1 children)

u/MostlyRocketScience has some good recommendations (I myself had a lot of fun asking OpenHermes 2.5 to start text adventures, though it has a habit of going on unless you set the generation length to 200 or lower).

If you mean recreating AI Dungeon literally, there's Dan's Adventurous Winds 7B (based off of the well-received 7B "Mistral" models), which has been trained on text adventure datasets.

There's also these which were trained on the original AI Dungeon dataset (which was pretty unhinged), but they aren't the same size you're looking for:

  • AI Dungeon 2 Classic (1.5B, the original GPT-2 model; to run it under Oobabooga you need to use the "ctransformers" loader)

  • Spring Dragon (13B, intended to replicate AI Dungeon's paid GPT-3 model from 2020)

[โ€“] iChrist@alien.top 1 points 10 months ago

Any reason for Kobold instead of Ooba+SillyTavern?