this post was submitted on 24 Nov 2023
1 points (100.0% liked)

LocalLLaMA

4 readers
4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
communick@poweruser.forum
1
Is it just me or is prompt engineering basically useless with smaller models? (alien.top)
submitted 2 years ago by Weird_Foundation5044@alien.top to c/localllama@poweruser.forum
19 comments fedilink hide all child comments
 

I tried to apply a lot of prompting techniques in 7b and 13b models. And no matter how hard I tried, there was barely any improvement.

you are viewing a single comment's thread
view the rest of the comments
[–] Ravenpest@alien.top 1 points 2 years ago

At present the simpler and narrower the scope of the instruction the better. They cannot understand complex tasks. Extrapolate how the model thinks in general, then focus on one thing in particular and arrange your prompt accordingly.