this post was submitted on 04 Dec 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

I seen a lot of posts here talking about this or that model being great for storytelling/writing but when I try them out the prose is…well…flat, boring and plain unfunny. I’m not interested in models to write NSFW (nothing against it just not my thing). I’m looking for models that can actually output stuff that sounds literary - for example, if I ask the model to write something in the style of x (where x is an author with a very unique style) that the output has some of the author’s style in it. Or if I ask it to write a poem, that the result isn’t like something out of some kid’s book written by Dr. Seuss.

With the exception of one model I tried [Storywriter 13b] (which sort of produced something literary after a little coaxing and leading). All the others produced results which sounded like entries from an encyclopedia or dictionary (lifeless, droning, emotionless, etc.). And the leaderboard hasn’t been much help in identifying anything that’s close to what I’m looking for - the top rated models I have tried are the worst when it comes to prose of the kind I’m looking for, in my limited experience.

Does anyone know of any models, that I can run on my local computer, that can produce “literary” prose (I.e. moving, detailed descriptions plus creative story writing)? Not looking for perfect just better… I’m hoping one of you might have come across a model I haven’t seen/tried so any and all suggestions will be appreciated.

you are viewing a single comment's thread
view the rest of the comments
[–] Heliogabulus@alien.top 1 points 11 months ago

Interesting result you got there. Good job! Finetuning is probably the way to go for consistent results for a given style.

I have been able to get closer to what I want via prompting with one model but not perfectly. For example, I asked a model to write a detailed description of an object in the style of Charles Dickens and although it deviated every so often from the style, overall it felt very “Dickens-esque”. Result quality varied depending on the author I prompted for. But most of the models I have tried (large and small) totally ignored the prompt and wrote bland encyclopedia entries. At the very least, I’d like a model that knows something about classic authors and their works - but I know it’s a big ask.

BTW, if you ever decide to write that book of yours, I’d be interested in reading it!