LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

submitted 1 year ago by fakezeta@alien.top to c/localllama@poweruser.forum

6 comments fedilink hide all child comments

Couldn't wait for the great TheBloke to release it so I've uploaded a Q5_K_M GGUF of Intel/neural-chat-7b-v3-1.

From some preliminary test on PISA sample questions it seems at least on par with OpenHermers-2.5-Mistral-7B

you are viewing a single comment's thread
view the rest of the comments

[–] AdamDhahabi@alien.top 1 points 11 months ago (1 children)

Interested to know how it scores for RAG use cases, there is a benchmark for that https://github.com/vectara/hallucination-leaderboard

Up to now, Mistral underperforms Llama2.

[–] fakezeta@alien.top 1 points 11 months ago

Currently all the finetuned version of Mistral I've tested have a high rate of hallucination: this one also seems to have this tendency.