TL;DR:
- Uncensored, Llama 2 70B based model for collaborative/steerable story writing and chat / role-play.
- Hugging Face link:
- Try for free on dreamgen.com. Don't forget to select it in the editor, otherwise you get the 7B.
Hey everyone, I am following up on my post from last week, and releasing a 70B version of DreamGen Opus V0.
What is collaborative / steerable story writing?
You can find more details about prompting the model in the official prompting guide. Make sure to checkout the examples, like “You can stop time. What will you do?”, “Natasha Romanoff and me…” or “The mischievous Coven”.
In summary: It allows you to describe a story, generate / write a part of it, and then further steer the story with inline instructions, like:
(Initial description of the story)
(Can include character description)
(Previously generated or written part of the story)
(Inline instructions describing how the story should develop next)
(The model will steer it in the direction within the next few sentences / paragraphs)
How to do chat / role-play?
Very similar to regular story writing, but:
- In the story description, mention that it’s written in the form of a dialog or in first person (depending on preferences).
- Preferably include character definitions.
- After ``, kick off the chat / role-play with 2-3 example dialog turns, using the format you want, e.g.:
See the examples tagged as "chat" from the official guide linked above.
How to try it out
The model should work great with any tool that supports the Llama 70B base model.
The model is large, therefore not everyone might be able to run it locally. To that end, you can try it for free on dreamgen.com (at least while I can support it :)).
What’s next
Last time I asked the community what I should work on next (you can still vote here). The most requested thing was better support for creating & sharing characters, both on the tooling side & model side (there’s tons of headroom when it comes to data, etc.) — stay tuned for updates in the coming weeks.
Want to join the fun and influence the direction of DreamGen? Join our community server.
Assuming that DreamGen is a commercial product, it might be good to invest in Kalomaze. They invented the Min P method for better token sampling, and are developing a Dynamic Temperature that might replace Mirostat. Giving them a grant to develop such techniques could help improve the output of Opus and other models, with DreamGen getting the first opportunity to offer those improvements to customers.
As a user of models, I personally have difficulty figuring out the ideal preset for a model. Having recommendations for the model and app would be good. EG: "Opus Storyteller", "Opus Roleplay", and "Opus Assistant".
It would also be cool to have a "Preset Arena" feature, where the AI is automated to create a number of responses to a prompt, each with different parameters. The user then picks out the best responses, which in turn get a deviation. As time goes on, the user can favorite the outputs that have the best results.
For example, Preset Arena results tagged "KoboldCPP", "Yi-34b-200k 120 Days of Opus v7.2", "NSFW", "1024 Token Generation", and "Story Mode", could be shared with DreamGen and other users on a scoreboard. In effect, this would allow the user and DreamGen to co-develop presets that are most suitable for a given task, client, and model.
Aside from all of that, I would like to try a Yi-34b-200k Opus.