LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Fill in middle fine-tuning LLM (alien.top)

submitted 1 year ago by Dry_Long3157@alien.top to c/localllama@poweruser.forum

0 comments fedilink hide all child comments

Hey, I am looking to fine-tune a LLM with the fim method but I am not able to find any repos online that I can use/follow. inCoder from meta also is trained in a similar way but I can't find the training code for that either.

I think think this method can be particularly useful when training models to "learn" a particular library or a codebase it hasn't seen before, or atleast that is my hypothesis.

Please let me know if you find any resources. TIA.

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here