mdutAi

joined 2 years ago
[โ€“] mdutAi@alien.top 1 points 2 years ago

In my opinion, the "zephyr 7b beta" model is the best among the 7b models in terms of humane behaviors and reading comprehension. The disadvantage of this model is coding and mathematics. Here is the information screen

https://cdn-uploads.huggingface.co/production/uploads/6200d0a443eb0913fa2df7cc/raxvt5ma16d7T23my34WC.png

Also, if you would like to examine the model:

https://huggingface.co/HuggingFaceH4/zephyr-7b-beta

โ€‹

I can run it with Langchain on a laptop with RTX2060 6gb Ram and i7 11h and 32 ram.

The secret is INT4