LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Best model to recreate AI Dungeon. (alien.top)

submitted 1 year ago by RexorGamerYt@alien.top to c/localllama@poweruser.forum

9 comments fedilink hide all child comments

So, a couple years ago, i found something called AI dungeon, it was my first contact with an AI model. It was very good until it got censored af. The version i used was probably using GPT 2 or 1 (idk)

Is there any model that can compare or is better for text based RPGS that isn't very censored and preferably 7b (im running on oobagooba with my CPU)

Note: Sorry if i used the wrong terminology, I'm still a total noob lol. I discovered you can run your own language model just 2 days ago, and don't worry, I'm not trying to fulfill some weird fetish 💀.

top 9 comments

sorted by: hot top controversial new old

[–] MostlyRocketScience@alien.top 1 points 1 year ago

Here is a good comparison: https://www.reddit.com/r/LocalLLaMA/comments/17kpyd2/huge_llm_comparisontest_part_ii_7b20b_roleplay/

Basically you should try OpenHermes-2-Mistral-7B or LLaMA2-13B-Tiefighter-GGUF

[–] rainbowkarin@alien.top 1 points 1 year ago (1 children)

u/MostlyRocketScience has some good recommendations (I myself had a lot of fun asking OpenHermes 2.5 to start text adventures, though it has a habit of going on unless you set the generation length to 200 or lower).

If you mean recreating AI Dungeon literally, there's Dan's Adventurous Winds 7B (based off of the well-received 7B "Mistral" models), which has been trained on text adventure datasets.

There's also these which were trained on the original AI Dungeon dataset (which was pretty unhinged), but they aren't the same size you're looking for:

AI Dungeon 2 Classic (1.5B, the original GPT-2 model; to run it under Oobabooga you need to use the "ctransformers" loader)
Spring Dragon (13B, intended to replicate AI Dungeon's paid GPT-3 model from 2020)

[–] iChrist@alien.top 1 points 1 year ago

Any reason for Kobold instead of Ooba+SillyTavern?

[–] Prince_Noodletocks@alien.top 1 points 1 year ago (1 children)

I have a dungeon crawl character card that always just keeps my "inventory" in a list after the narration on every prompt, but the model I use might be too heavy since I use a dual 3090 setup, Dolphin 2.2 70B.

[–] RexorGamerYt@alien.top 1 points 1 year ago

Damnnn that's a sick setup, btw how can i get these characters?

[–] Igoory@alien.top 1 points 1 year ago

Llama2 base model can do it reasonably well.

[–] _supert_@alien.top 1 points 1 year ago

You might like this if you're looking to go a bit beyond AI dungeon.

[–] neph1010@alien.top 1 points 1 year ago

I'm working on something similar, but different: https://github.com/neph1/LlamaTale

It will never allow the kind of freedom that a pure storytelling model will give you. But the goal is to provide a more stable experience. I've made a number of posts about it here (and the next one is due, soon), but here's the first:

https://www.reddit.com/r/LocalLLaMA/comments/152w71n/mud_llm_for_a_stronger_roleplaying_experience/

It runs fairly well with a 7b, https://huggingface.co/TokenBender/llama2-7b-chat-hf-codeCherryPop-qLoRA-merged being the one I play with, mostly.

[–] DannyBrownMz@alien.top 1 points 1 year ago

Goliath 120B. The best model for Role-playing (for my usecase: mostly interactive fiction/RPG) that I've ever used till date. https://huggingface.co/alpindale/goliath-120b