LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Is anyone experimenting with non-instruction tuned models? (alien.top)

submitted 11 months ago by wojcech@alien.top to c/localllama@poweruser.forum

5 comments fedilink hide all child comments

My main usecase for LLMs is literally as an auto-complete, mainly via coding, so I was wondering whether anyone has played with/had any luck using the base model for use cases that are close to simply auto completing? I could imagine the instruction tuning adding a sycophancy bias in those areas

you are viewing a single comment's thread
view the rest of the comments

[–] FPham@alien.top 1 points 11 months ago (1 children)

Get a base model of your choice, finetune it with plain text book of a style you want it to talk. Done.

[–] wojcech@alien.top 1 points 11 months ago

Fine tune as in gradient updates or as in ICL?