LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

What is the best 7B model for reading comprehension and instruction following at the moment? (alien.top)

submitted 10 months ago by Outrageous-Drama924@alien.top to c/localllama@poweruser.forum

9 comments fedilink hide all child comments

Hi, can you guys suggest me some 7b models good at reading comprehension and instruction following

you are viewing a single comment's thread
view the rest of the comments

[–] synw_@alien.top 1 points 10 months ago (1 children)

For me Mistral 7B Instruct is now the best one for following instructions closely. However I still have to try some recent ones that seems to have a good reputation, like OpenChat, Zephyr or Synthia for instruction following and specialized tasks

[–] sergeant113@alien.top 1 points 10 months ago

I agree. My use case involves generating json outputs, and no other mistral finetune has even come close to matching the outputs of mistral-instruct. Instruct comes very close to the performance of gpt-3.5-turbo even.