this post was submitted on 10 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Finetuning LLMs: Does it add new knowledge to model or not? (alien.top)
submitted 10 months ago by Euphoric-Nebula-4559@alien.top to c/localllama@poweruser.forum
8 comments fedilink hide all child comments
 

Can you share your experiences?

you are viewing a single comment's thread
view the rest of the comments
[–] liquiddandruff@alien.top 1 points 10 months ago

Yes, people have done experiments with fine tuning on just a dump of the ue5 game engine documentation and it was able to recall the changes in the new documentation that wasn't in the base model. The repo for this is on GitHub, you should be able to find it.