LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

New Model: openchat 3.5 with 16k context (huggingface.co)

submitted 1 year ago by perlthoughts@alien.top to c/localllama@poweruser.forum

20 comments fedilink hide all child comments

openchat 3.5 16k

you are viewing a single comment's thread
view the rest of the comments

[–] hibbity@alien.top 1 points 1 year ago (1 children)

I would but anyone that puts that much effort into a model release and doesn't include the trained prompt formats just seems like they must not want me to use it.

[–] perlthoughts@alien.top 1 points 1 year ago (1 children)

Yeah I agree, its kind of weird, but you dont have to use GPT4 Correct User: etc, GPT4 User: works better imo. However, this is just the prompt they used when training the model, so its best to follow it.

[–] hibbity@alien.top 1 points 1 year ago

I would be stoked and actually mess with it if it had a proper instruct or system tag. The results from models trained like that are just easier to tune.