LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Simple trainer script! (alien.top)

submitted 11 months ago by Dry_Long3157@alien.top to c/localllama@poweruser.forum

3 comments fedilink hide all child comments

Hey everyone,

I came across a post recently where someone found it hard to find simple scripts to fine-tune LLMs with their data. So I put together a repo where you can just type out your requirements in a config.yaml file and the training happens flawlessly based on that.

Here's the repo - LLM-Trainer

It is still a wip so lemme know if guys want some other features added to this.

TIA.

you are viewing a single comment's thread
view the rest of the comments

[–] uhuge@alien.top 1 points 11 months ago

I assume auth_token is for storing the merged model in HF? Seems worth noting/clarifying.

I'll get back with more feedback when I get to test it.+)