this post was submitted on 12 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
 

As the title states. I have been unable to find anything that people new to AI can understand. I have found countless YouTube and other website tutorials...but they're way above my proverbial pay grade.

I'm a copywriter and know nothing about how to fine tune AI.

I followed an online guide and somehow managed to get LLaMA 13b working on my 4090, i7-10-700k, and 64gb of RAM PC.

While it works just fine...I'm having an issue with LLaMA 13b, Claude 2, and ChatGPT.

All three AIs cannot write at the level I need them to. They also have a piss-poor memory (e.g., Claude 2 forgets that I instructed it to "don't use passive voice" two messages ago).

So, I'm hoping there is a way to fine tune LLaMA 13b so that whenever I ask it to perform a writing task it will:

  • Write in active voice only
  • Don't write overly complex sentences with mutiple commas
  • Begin blurbs with a straightforward benefit statement that establishes value
  • Use natural language and syntax
  • Add something substantive that complements the existing messaging while avoiding redundant phrasing
  • Etc etc etc

Without me having to remind it.

Do you know if this is possible and how hard it will be for a total n00b like myself to accomplish. And can I accomplish this on my 4090 rig?

โ€‹

<> Or is fine tuning not intended for what I need AI to do?

top 1 comments
sorted by: hot top controversial new old
[โ€“] knownboyofno@alien.top 1 points 10 months ago

Have you set up the system message with those exact requirements? The system message is sent along with each prompt if I am not mistaken.