this post was submitted on 21 Nov 2023
1 points (100.0% liked)

LocalLLaMA

4 readers
4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
top 14 comments
sorted by: hot top controversial new old
[–] The_Choir_Invisible@alien.top 1 points 2 years ago (1 children)

Wait, this is the actual Orca? Since this is 2, is it fair to guess they neutered the shit out of it compared to the original?

[–] faldore@alien.top 1 points 2 years ago

Yes. This is real Microsoft Orca that they never released. But version 2.

[–] yahma@alien.top 1 points 2 years ago

Dataset release??

[–] RayIsLazy@alien.top 1 points 2 years ago

Will they release the dataset so we can try it out on mistral?

[–] Amgadoz@alien.top 1 points 2 years ago

It's source available, not open source. They don't even allow commercial usage.

[–] kpodkanowicz@alien.top 1 points 2 years ago

wow, and also they use chatml format... I know some top ppl here started to use it, but i wonder if they know something the rest of us doesnt :D

[–] Happy_Chicken9835@alien.top 1 points 2 years ago

The bloke has a few quantized variants

A gguf 7B: https://huggingface.co/TheBloke/Orca-2-7B-GGUF

[–] ambient_temp_xeno@alien.top 1 points 2 years ago (1 children)

Remember when Orca 1 was supposedly this amazing thing that nobody would ever catch up to? Ambient_temp_xeno remembers.

[–] ArmoredBattalion@alien.top 1 points 2 years ago

we are witnessing accelerated evolution

[–] Majestical-psyche@alien.top 1 points 2 years ago (1 children)

Now we need someone to de-neuter this and make it less bias. I wonder how both the 7B and 13B compares with Mistral. So far it’s hype until I see other people’s results-tests.

[–] Slimxshadyx@alien.top 1 points 2 years ago

Dolphin man please!

[–] Slimxshadyx@alien.top 1 points 2 years ago

u/faldore

Does this mean Dolphin2 coming? I’m hoping so! I love the current dolphin models

[–] squareOfTwo@alien.top 1 points 2 years ago

looks like a great model to test / use for certain "reasoning" / reasoning use cases.

[–] akumaburn@alien.top 1 points 2 years ago

It would be nice to see uncensored versions of this. Though I suppose the use case is limited due to the license.