LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

MonadGPT, an early modern chatbot trained on Mistral-Hermes and 17th century books. (alien.top)

submitted 10 months ago by Dorialexandre@alien.top to c/localllama@poweruser.forum

11 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Dorialexandre@alien.top 1 points 10 months ago

Well that was actually my original motivation for finetuning. Even GPT-4 is not so good with a proper prompt: the text feels fake and/or struggle to maintain cultural consistency. I think finetuning works better for this task, as there are too many directives to give and it helps to relieve the model from anachronistic RLHF.

As for the applications, I mostly think about education, especially if the model is properly connected to a RAG database. Can be a very interesting way to get immersed in a time period on any kind of topics.