kaszebe

joined 11 months ago
[–] kaszebe@alien.top 1 points 10 months ago (1 children)

Is there a guide for dummies (read: me) to get this to work on oobabooga?

[–] kaszebe@alien.top 1 points 10 months ago

Mistral-7B gave me good results

Can you expand upon that? Do you mean in terms of its ability to write at a college level without major grammatical errors?

 

As the title states. I have been unable to find anything that people new to AI can understand. I have found countless YouTube and other website tutorials...but they're way above my proverbial pay grade.

I'm a copywriter and know nothing about how to fine tune AI.

I followed an online guide and somehow managed to get LLaMA 13b working on my 4090, i7-10-700k, and 64gb of RAM PC.

While it works just fine...I'm having an issue with LLaMA 13b, Claude 2, and ChatGPT.

All three AIs cannot write at the level I need them to. They also have a piss-poor memory (e.g., Claude 2 forgets that I instructed it to "don't use passive voice" two messages ago).

So, I'm hoping there is a way to fine tune LLaMA 13b so that whenever I ask it to perform a writing task it will:

  • Write in active voice only
  • Don't write overly complex sentences with mutiple commas
  • Begin blurbs with a straightforward benefit statement that establishes value
  • Use natural language and syntax
  • Add something substantive that complements the existing messaging while avoiding redundant phrasing
  • Etc etc etc

Without me having to remind it.

Do you know if this is possible and how hard it will be for a total n00b like myself to accomplish. And can I accomplish this on my 4090 rig?

<> Or is fine tuning not intended for what I need AI to do?