LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

Has anyone fine tuned a local model on their company database? (alien.top)

submitted 9 months ago by SuperSizedFri@alien.top to c/localllama@poweruser.forum

6 comments fedilink hide all child comments

Curious if it can be connected to, or set up to update fine tunings on a schedule? Admittedly I’ve only slightly paid attention RAG so far, but not sure if this is a step further, or already a current capability.

you are viewing a single comment's thread
view the rest of the comments

[–] SuperSizedFri@alien.top 1 points 9 months ago

Ok great. So if we aren’t getting great results with RAG, then fine tune with our own dataset on our language to see if that helps.

I’m hoping to find an automated way to RAG, ideally with a db connection but maybe could set up an api script to export data from the db and upload to the model. I assume at least the second option exists, so I’ll be looking.