this post was submitted on 13 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
dolphin-2.2-yi-34b released (alien.top)
submitted 10 months ago by Amgadoz@alien.top to c/localllama@poweruser.forum
34 comments fedilink hide all child comments
 

Eric Hartford, the author of dolphin models, released dolphin-2.2-yi-34b.

This is one of the earliest community finetunes of the yi-34B.

yi-34B was developed by a Chinese company and they claim sota performance that are on par with gpt-3.5

HF: https://huggingface.co/ehartford/dolphin-2_2-yi-34b

Announcement: https://x.com/erhartford/status/1723940171991663088?s=20

you are viewing a single comment's thread
view the rest of the comments
[–] WolframRavenwolf@alien.top 1 points 10 months ago (1 children)

Easiest way on Windows: koboldcpp with TheBloke/dolphin-2_2-yi-34b-GGUF. Download both, then drag and drop the GGUF on top of koboldcpp.exe.

[–] YearZero@alien.top 1 points 10 months ago (1 children)

s I found today and it seems close enough to dolphin 70b at half the size.

I'm getting broken replies in koboldcpp, although it runs perfectly in llamacpp for me. Not sure why, koboldcpp is my go to.

[–] llama_in_sunglasses@alien.top 1 points 10 months ago

You need to rebuild or download a newer koboldcpp.