??
It's comparing base models (which are not trained to follow or refuse instructions) against instruction-tuned ones (OpenAI)
this post was submitted on 27 Nov 2023
1 points (100.0% liked)
LocalLLaMA
11 readers
4 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 2 years ago
MODERATORS
afety checks in Llama 2
it seems it's comparing chat models: https://airtable.com/app8zluNDCNogk4Ld/shrYRW3r0gL4DgMuW/tblpLubmd8cFsbmp5
Looks like you've now made some changes. Columns now read "Llama2-7b-chat" instead of "llama2." Also, chat responses below the completions, chastising the inappropriate messages. However, a completion was generated, first, and the item is still marked as "fail." Very poor show
It's not clear if this is testing the chat model or the base model. Assuming it is the base model, it isn't surprising: it's just a text completion model with no extra frills. The point of the safety alignment training is that it's part of the instruct dataset and training, not the base model.
This is what you want, even if you're concerned about safety. You don't want the safety to be baked in to the raw completion model: if some future better way comes along to do safety training, you want to be able to use it without retraining the entire model from scratch. (And given the speed at which this stuff moves, that might be just a week from now.)
Of course, if you're concerned about safety you shouldn't be deploying the raw text completion model to end users. (For a whole host of reasons, not just safety.)