SuperSizedFri

joined 9 months ago
sorted by: new top controversial old
Has anyone fine tuned a local model on their company database? in c/localllama@poweruser.forum
[–] SuperSizedFri@alien.top 1 points 9 months ago

Ok great. So if we aren’t getting great results with RAG, then fine tune with our own dataset on our language to see if that helps.

I’m hoping to find an automated way to RAG, ideally with a db connection but maybe could set up an api script to export data from the db and upload to the model. I assume at least the second option exists, so I’ll be looking.

Has anyone fine tuned a local model on their company database? in c/localllama@poweruser.forum
[–] SuperSizedFri@alien.top 1 points 9 months ago (1 children)

Ok, so I’ll look more into RAG. I just saw Mathew Bermans video on creating agents with YouAI, but I’m hoping for something that’ll connect to our database (or even just a couple specific tables) instead of having to manually export csv files from my db to then upload.

1
Has anyone fine tuned a local model on their company database? (alien.top)
 

Curious if it can be connected to, or set up to update fine tunings on a schedule? Admittedly I’ve only slightly paid attention RAG so far, but not sure if this is a step further, or already a current capability.