LocalLLaMA

11 readers

4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

communick@poweruser.forum

This model is extremely good (alien.top)

submitted 2 years ago by noobgolang@alien.top to c/localllama@poweruser.forum

15 comments fedilink hide all child comments

I have been using this as daily driver for a few days, very good, i never thought 7B model can achieve this level of coding + chat
https://huggingface.co/TheBloke/OpenHermes-2.5-neural-chat-7B-v3-1-7B-GGUF

you are viewing a single comment's thread
view the rest of the comments

[–] LoSboccacc@alien.top 1 points 2 years ago (1 children)

yeah possibly one of the best for rag at this size, it sticks to facts extremely well, but it's hard to have it do any form of creative interpretation of the context.

[–] zis1785@alien.top 1 points 2 years ago

Curious to know if you have built a RAG application with it ? Any specific embedding models you used ?