this post was submitted on 24 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Is it just me or is prompt engineering basically useless with smaller models? (alien.top)
submitted 10 months ago by Weird_Foundation5044@alien.top to c/localllama@poweruser.forum
19 comments fedilink hide all child comments
 

I tried to apply a lot of prompting techniques in 7b and 13b models. And no matter how hard I tried, there was barely any improvement.

you are viewing a single comment's thread
view the rest of the comments
[–] penguished@alien.top 1 points 10 months ago

I don't find it useless at all. It's just more mysterious because sometimes one line of prompt gets you the best results, and sometimes it will actually listen to much more detailed instructions... but it's a bit of a crap shoot and trial and error.