LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

dolphin-2.2-yi-34b released (alien.top)

submitted 1 year ago by Amgadoz@alien.top to c/localllama@poweruser.forum

34 comments fedilink hide all child comments

Eric Hartford, the author of dolphin models, released dolphin-2.2-yi-34b.

This is one of the earliest community finetunes of the yi-34B.

yi-34B was developed by a Chinese company and they claim sota performance that are on par with gpt-3.5

HF: https://huggingface.co/ehartford/dolphin-2_2-yi-34b

Announcement: https://x.com/erhartford/status/1723940171991663088?s=20

you are viewing a single comment's thread
view the rest of the comments

[–] WolframRavenwolf@alien.top 1 points 1 year ago (9 children)

I took a short break from my 70B tests (still working on that!) and tried TheBloke/dolphin-2_2-yi-34b-GGUF Q4_0. It instantly claimed 4th place on my list.

A 34B taking 4th place among the 13 best 70Bs! A 34B model that beats 9 70Bs (including dolphin-2.2-70B, Samantha-1.11-70B, StellarBright, Airoboros-L2-70B-3.1.2 and many others). A 34B with 16K native context!

Yeah, I'm just a little excited. I see a lot of potential with the Yi series of models and proper finetunes like Eric's.

Haven't done the RP tests yet, so back to testing. Will report back once I'm done with the current batch (70Bs take so damn long, and 120B even more so).

[–] TobyWonKenobi@alien.top 1 points 1 year ago

Agreed - This is the best conversational model I have tried yet.

34B is the largest model size that I prefer running on my GPU, and this along with Nous-Capybara are fantastic.

load more comments (8 replies)