this post was submitted on 27 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Just to be clear, you aren't doing fine tuning here as in gradient updates, you are using the base model + ICL?
Yep, basically like taking a few samples from a dataset and turning them into a short text "document" with an obvious pattern so the LLM will complete it
Few-shot vs fine-tuning comparison:
Pros:
Cons: