this post was submitted on 21 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
top 14 comments
sorted by: hot top controversial new old
[–] The_Choir_Invisible@alien.top 1 points 10 months ago (1 children)

Wait, this is the actual Orca? Since this is 2, is it fair to guess they neutered the shit out of it compared to the original?

[–] faldore@alien.top 1 points 10 months ago

Yes. This is real Microsoft Orca that they never released. But version 2.

[–] yahma@alien.top 1 points 10 months ago

Dataset release??

[–] RayIsLazy@alien.top 1 points 10 months ago

Will they release the dataset so we can try it out on mistral?

[–] Amgadoz@alien.top 1 points 10 months ago

It's source available, not open source. They don't even allow commercial usage.

[–] kpodkanowicz@alien.top 1 points 10 months ago

wow, and also they use chatml format... I know some top ppl here started to use it, but i wonder if they know something the rest of us doesnt :D

[–] Happy_Chicken9835@alien.top 1 points 10 months ago

The bloke has a few quantized variants

A gguf 7B: https://huggingface.co/TheBloke/Orca-2-7B-GGUF

[–] ambient_temp_xeno@alien.top 1 points 10 months ago (1 children)

Remember when Orca 1 was supposedly this amazing thing that nobody would ever catch up to? Ambient_temp_xeno remembers.

[–] ArmoredBattalion@alien.top 1 points 10 months ago

we are witnessing accelerated evolution

[–] Majestical-psyche@alien.top 1 points 10 months ago (1 children)

Now we need someone to de-neuter this and make it less bias. I wonder how both the 7B and 13B compares with Mistral. So far it’s hype until I see other people’s results-tests.

[–] Slimxshadyx@alien.top 1 points 10 months ago

Dolphin man please!

[–] Slimxshadyx@alien.top 1 points 10 months ago

u/faldore

Does this mean Dolphin2 coming? I’m hoping so! I love the current dolphin models

[–] squareOfTwo@alien.top 1 points 10 months ago

looks like a great model to test / use for certain "reasoning" / reasoning use cases.

[–] akumaburn@alien.top 1 points 10 months ago

It would be nice to see uncensored versions of this. Though I suppose the use case is limited due to the license.