this post was submitted on 09 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Fill in middle fine-tuning LLM (alien.top)
submitted 10 months ago by Dry_Long3157@alien.top to c/localllama@poweruser.forum
0 comments fedilink hide all child comments
 

Hey, I am looking to fine-tune a LLM with the fim method but I am not able to find any repos online that I can use/follow. inCoder from meta also is trained in a similar way but I can't find the training code for that either.

I think think this method can be particularly useful when training models to "learn" a particular library or a codebase it hasn't seen before, or atleast that is my hypothesis.

Please let me know if you find any resources. TIA.

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here