this post was submitted on 26 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Is Open LLM Leaderboard reliable source ? yi:34B is at the top but I get better results with neural-chat:7B model (alien.top)
submitted 9 months ago by grigio@alien.top to c/localllama@poweruser.forum
23 comments fedilink hide all child comments
 

I use in both cases q4_K_M

you are viewing a single comment's thread
view the rest of the comments
[–] FullOf_Bad_Ideas@alien.top 1 points 9 months ago

Are you talking about base yi-34B or a fine-tuned one? Base model will be hard to use but will score pretty high. Benchmarks are generally written with completion in mind, so they work really well on base models and instruct tuning may make it much easier to work with but not necessarily score higher on benchmarks.