this post was submitted on 31 Oct 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
 

I’m tired of rolling my own infra to capture chat input and outputs, label it, and feed it to a training pipeline.

Is there a go to service / open source framework out there that will do all of this easier?

you are viewing a single comment's thread
view the rest of the comments
[–] oKatanaa@alien.top 1 points 10 months ago

Not sure what kind of software you need, but here is a tool for 'easy' (by hand) gathering of chat datasets for later finetuning: oKatanaaa/lima-gui: A simple GUI utility for gathering LIMA-like chat data. (github.com)

Early work in progress, but may be worth a try.