this post was submitted on 13 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
dolphin-2.2-yi-34b released (alien.top)
submitted 1 year ago by Amgadoz@alien.top to c/localllama@poweruser.forum
34 comments fedilink hide all child comments
 

Eric Hartford, the author of dolphin models, released dolphin-2.2-yi-34b.

This is one of the earliest community finetunes of the yi-34B.

yi-34B was developed by a Chinese company and they claim sota performance that are on par with gpt-3.5

HF: https://huggingface.co/ehartford/dolphin-2_2-yi-34b

Announcement: https://x.com/erhartford/status/1723940171991663088?s=20

you are viewing a single comment's thread
view the rest of the comments
[–] OrdinaryAdditional91@alien.top 1 points 1 year ago (1 children)

It seems like sally test is included in the training set nowadays?

https://preview.redd.it/248fongjm80c1.png?width=901&format=png&auto=webp&s=1944b2dfcda2c84fb29d69520f54bc35fda2dbb9

[–] ambient_temp_xeno@alien.top 1 points 1 year ago (1 children)

It seems it's in the 'base' model. As I came up with the '(a girl)' part I've had something immortalized in a Chinese AI model. I suppose.

Without the prompt dolphin uses, I get his (using rep pen 1.1, not sure why that affects it)

Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have?

The answer is Sally has 1 sister.

Here's the reasoning:

  1. Sally has 3 brothers.
  2. Each of her brothers has 2 sisters.
  3. So, each of her brothers has the same 2 sisters.
  4. Therefore, there are only 2 sisters in total (not 4).
  5. Since Sally is one of those sisters, she has just 1 sister left.

That's it! The answer is that Sally has 1 sister.

[–] OrdinaryAdditional91@alien.top 1 points 11 months ago (1 children)

Today the Yi chat model is released, I just done the sally test and here is the result:

​

https://preview.redd.it/nft8z38pz22c1.png?width=928&format=png&auto=webp&s=8fb90685cfc43f30fd17e2957aa2161fabbf3e4a

[–] ambient_temp_xeno@alien.top 1 points 11 months ago

I had nous capy34 get it right a couple of days ago with these settings

https://www.reddit.com/r/LocalLLaMA/comments/17uskx7/comment/k9c1wcc/?utm_source=share&utm_medium=web2x&context=3

Which is interesting. I want to test this new yi chat because apparently it can do decent ASCII?! Need a gguf though.