LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

submitted 9 months ago by Legcor@alien.top to c/localllama@poweruser.forum

49 comments fedilink hide all child comments

I came across this new finetuned model based on Openchat 3.5 which is apparently trained used Reinforcement Learning from AI Feedback (RLAIF).

you are viewing a single comment's thread
view the rest of the comments

[–] PrometheusZer0@alien.top 1 points 9 months ago (4 children)

Does somebody have a prompt template for this? Trying to run in ollama

[–] PrometheusZer0@alien.top 1 points 9 months ago (3 children)

Here's what I'm using:

FROM starling-lm-7b-alpha.Q5_K_M.gguf

PARAMETER stop <|end_of_turn|>

PARAMETER stop <|im_sep|>

TEMPLATE """

GPT4 User: {{.Prompt}}<|end_of_turn|>GPT4 Assistant:

"""

[–] visarga@alien.top 1 points 9 months ago (2 children)

how do you add your own gguf into ollama? it seems to be storing models as cryptic binary blobs in a folder.

[–] PrometheusZer0@alien.top 1 points 9 months ago

load more comments (1 replies)