LocalLLaMA

14 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

communick@poweruser.forum

Novel Writing (alien.top)

submitted 2 years ago by Jenniher@alien.top to c/localllama@poweruser.forum

10 comments fedilink hide all child comments

I have been playing with llms for novel writing. Thus far all I have been able to use them for is brainstorming. No matter the model I use the prose feels wooden, dull, and obviously AI.

Is anyone else doing this? Are there particular models that work really well or any prompts you recommend? Any workflow advice you have to better leverage llms in any way would be very appreciated!

you are viewing a single comment's thread
view the rest of the comments

[–] ambient_temp_xeno@alien.top 1 points 2 years ago (1 children)

I agree. I have these for yichat34 --top-k 0 --min-p 0.05 --top-p 1.0 --color -t 5 --temp 3 --repeat_penalty 1 -c 4096 -i -n -1

I think the --min-p I have is a bit low, so maybe you have the min-p back to front? Lower is more precise I think.

[–] pseudonerv@alien.top 1 points 2 years ago

--top-k 0 is the same as --top-k 1, so fully deterministic, no?