this post was submitted on 23 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Just wondering what are peoples go to LLM's when they really want to get creative/unique stories. What I am mainly looking for is creative sparks of brilliance that really feel like it's something fresh/unique/creative with writing that just flows well.

Mine are as follows (using KoboldCPP):

1.) psymedrp-v1-20b.Q5_K_M Settings: Quick Preset: Mayday, Temp 1.2, Top P Sampling 0.99

link: https://huggingface.co/TheBloke/PsyMedRP-v1-20B-GGUF

Notes: This one really gets creative and has lines that make me smile for how outlandish, bizzare and creative they sometimes are. Sometimes goes a little off the deep end but generally this is one is a powerhouse of creativity.

2.) dolphin-2.1-mistral-7b.Q8_0 Settings: Quick Preset: Mayday, Temp 1.2, Top P Sampling 0.95

link: https://huggingface.co/TheBloke/dolphin-2.1-mistral-7B-GGUF

Notes: Love this little creative maestro. Very eloquent and the wordplay is fun and fresh with occasionally very poetic/flowery prose (sometimes a tad too much). Overall very solid.

3.) collectivecognition-v1.1-mistral-7b.Q8_0 Settings: Quick Preset: Mayday, Temp 1.3, Top P Sampling 0.95

link: https://huggingface.co/TheBloke/CollectiveCognition-v1.1-Mistral-7B-GGUF

Notes: Also just as creative as dolphin.2.1 with possibly a more serious tone. Also on occasion uses very techy words like ' algebra ', 'algorithmic' when describing mundane things but overall a solid creative 7b.

So what are your guys faves? (with settings too please).

you are viewing a single comment's thread
view the rest of the comments
[–] Dry-Judgment4242@alien.top 1 points 11 months ago (2 children)

Lzlv 70b still the best model by a mile for story writing.

[–] _supert_@alien.top 1 points 11 months ago (1 children)

It is very good. Synthia and Euryale are also very good.

For 13Bs Mythomax, Chrono-Hermes and Tiefighter are cool.

[–] LeanderGem@alien.top 1 points 11 months ago

Thanks. Another one that I've been testing out and is showing great potential is mythomist-7b

https://huggingface.co/TheBloke/MythoMist-7B-GGUF

[–] ChiefBigFeather@alien.top 1 points 11 months ago (1 children)

Lzlv 70b is good, but I found Airo 70b 3.1.2 a little better at grasping context.

[–] LeanderGem@alien.top 1 points 11 months ago

The little guys just can't beat the bigboys it seems. Time to upgrade, lol.