LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

This model is extremely good (alien.top)

submitted 11 months ago by noobgolang@alien.top to c/localllama@poweruser.forum

15 comments fedilink hide all child comments

I have been using this as daily driver for a few days, very good, i never thought 7B model can achieve this level of coding + chat
https://huggingface.co/TheBloke/OpenHermes-2.5-neural-chat-7B-v3-1-7B-GGUF

you are viewing a single comment's thread
view the rest of the comments

[–] LoSboccacc@alien.top 1 points 11 months ago (1 children)

yeah possibly one of the best for rag at this size, it sticks to facts extremely well, but it's hard to have it do any form of creative interpretation of the context.

[–] zis1785@alien.top 1 points 11 months ago

Curious to know if you have built a RAG application with it ? Any specific embedding models you used ?