LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

Is Open LLM Leaderboard reliable source ? yi:34B is at the top but I get better results with neural-chat:7B model (alien.top)

submitted 11 months ago by grigio@alien.top to c/localllama@poweruser.forum

23 comments fedilink hide all child comments

I use in both cases q4_K_M

you are viewing a single comment's thread
view the rest of the comments

[–] VertexMachine@alien.top 1 points 11 months ago (1 children)

It's a source. But rarely synthetic benchmarks give you the whole picture. Plus those test sets are in the public, so there is some incentive for some people to game the system (and even without that those data sets most likely are already in the training data).

[–] TobyWonKenobi@alien.top 1 points 11 months ago

I’ve had the same experience. Are you using GGUF? I do, and I’ve heard that Yi may suffer from GGUF. So EXL2 might be better… I need to try it and see.