this post was submitted on 01 Dec 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
RAG + real TXT book + Yi34b-chat = creative writing beast (alien.top)
submitted 11 months ago by Shir_man@alien.top to c/localllama@poweruser.forum
0 comments fedilink hide all child comments
 

I have tried recent model drops and will still stick to Ti34b-chat, as it is the most creative in terms of creative writing.

Then I attached the RAG approach to the model and fed to the embeddings the entire World War Z .txt book (zombie horrors lover here, guilty).

Here is what the story written with that approach looks like:

https://pastebin.com/4UL68WAm (raw output, no cherry-pick)

  1. What do you think about the creativity of the text?
  2. Has anyone tried to QLORA the real book, and does it help to "continue" the favorite books?
no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here