this post was submitted on 10 Nov 2023
1 points (100.0% liked)
LocalLLaMA
3 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
u/MostlyRocketScience has some good recommendations (I myself had a lot of fun asking OpenHermes 2.5 to start text adventures, though it has a habit of going on unless you set the generation length to 200 or lower).
If you mean recreating AI Dungeon literally, there's Dan's Adventurous Winds 7B (based off of the well-received 7B "Mistral" models), which has been trained on text adventure datasets.
There's also these which were trained on the original AI Dungeon dataset (which was pretty unhinged), but they aren't the same size you're looking for:
AI Dungeon 2 Classic (1.5B, the original GPT-2 model; to run it under Oobabooga you need to use the "ctransformers" loader)
Spring Dragon (13B, intended to replicate AI Dungeon's paid GPT-3 model from 2020)
Any reason for Kobold instead of Ooba+SillyTavern?