LocalLLaMA

4 readers

4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

communick@poweruser.forum

What is the best 7B model for reading comprehension and instruction following at the moment? (alien.top)

submitted 2 years ago by Outrageous-Drama924@alien.top to c/localllama@poweruser.forum

9 comments fedilink hide all child comments

Hi, can you guys suggest me some 7b models good at reading comprehension and instruction following

you are viewing a single comment's thread
view the rest of the comments

[–] mdutAi@alien.top 1 points 2 years ago

In my opinion, the "zephyr 7b beta" model is the best among the 7b models in terms of humane behaviors and reading comprehension. The disadvantage of this model is coding and mathematics. Here is the information screen

https://cdn-uploads.huggingface.co/production/uploads/6200d0a443eb0913fa2df7cc/raxvt5ma16d7T23my34WC.png

Also, if you would like to examine the model:

https://huggingface.co/HuggingFaceH4/zephyr-7b-beta

I can run it with Langchain on a laptop with RTX2060 6gb Ram and i7 11h and 32 ram.

The secret is INT4