this post was submitted on 22 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Has anyone explored Intel's new model yet? It's a 7B model trained on Slim Orca, which is currently the top 7B model on the HF open LLM leaderboard.

I've found other 7B models to be surprisingly helpful, especially for annotation/data extraction tasks, so I'm curious if it's worth replacing teknium/OpenHermes-2.5-Mistral-7B with this model.

you are viewing a single comment's thread
view the rest of the comments
[–] vatsadev@alien.top 1 points 11 months ago (3 children)

IMPORTANT!

this isnt trained, its another mistral finetune, with dpo, but with slimorca, not ultrachat.

I would be using openHermes, its much more trialed, and its proven solid

[–] ThinkExtension2328@alien.top 1 points 11 months ago (2 children)

Explain your train of thinking about open Hermes and what examples do you have ?

[–] vatsadev@alien.top 1 points 11 months ago (1 children)

OpenHermes 2.5 is the latest version, but the openHermes series has a history in ai models of being good, and I used it for some function calling, its really good

[–] ThinkExtension2328@alien.top 1 points 11 months ago

Just tried it can confirm this guy knows what he is talking about ^ , pretty great model tbh