LocalLLaMA

4 readers

4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

communick@poweruser.forum

Is it just me or is prompt engineering basically useless with smaller models? (alien.top)

submitted 2 years ago by Weird_Foundation5044@alien.top to c/localllama@poweruser.forum

19 comments fedilink hide all child comments

I tried to apply a lot of prompting techniques in 7b and 13b models. And no matter how hard I tried, there was barely any improvement.

you are viewing a single comment's thread
view the rest of the comments

[–] Kep0a@alien.top 1 points 2 years ago

It's definitely not useless, it's just doesn't understand instructions as literally as big models. Instead of asking it to write eloquently, if you play with delivering instructions in the context of what you want, it'll better convey the meaning.

Bad: "Write like you're in a wild west adventure."

Good: "Yee-haw, partner! Saddle up for a rip-roarin', gunslingin' escapade through the untamed heart of the Wild West!"

You also can't force it to what you want it to do. It depends on the training data. If I want it to output a short story, sometimes requesting a scenario, or book summary will give wildly different results.

I think prompt engineering is entirely for smaller models.