LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Has anyone fine tuned a local model on their company database? (alien.top)

submitted 11 months ago by SuperSizedFri@alien.top to c/localllama@poweruser.forum

6 comments fedilink hide all child comments

Curious if it can be connected to, or set up to update fine tunings on a schedule? Admittedly I’ve only slightly paid attention RAG so far, but not sure if this is a step further, or already a current capability.

you are viewing a single comment's thread
view the rest of the comments

[–] Mescallan@alien.top 1 points 11 months ago (1 children)

I agree with the other guy, you just need semantic search of some flavor unless you have industry specific language that the LLM won't understand well enough to write

[–] SuperSizedFri@alien.top 1 points 11 months ago

Ok great. So if we aren’t getting great results with RAG, then fine tune with our own dataset on our language to see if that helps.

I’m hoping to find an automated way to RAG, ideally with a db connection but maybe could set up an api script to export data from the db and upload to the model. I assume at least the second option exists, so I’ll be looking.