this post was submitted on 22 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
 

Has anyone explored Intel's new model yet? It's a 7B model trained on Slim Orca, which is currently the top 7B model on the HF open LLM leaderboard.

I've found other 7B models to be surprisingly helpful, especially for annotation/data extraction tasks, so I'm curious if it's worth replacing teknium/OpenHermes-2.5-Mistral-7B with this model.

you are viewing a single comment's thread
view the rest of the comments
[–] vatsadev@alien.top 1 points 10 months ago (3 children)

IMPORTANT!

this isnt trained, its another mistral finetune, with dpo, but with slimorca, not ultrachat.

I would be using openHermes, its much more trialed, and its proven solid

[–] ThinkExtension2328@alien.top 1 points 10 months ago (1 children)

Explain your train of thinking about open Hermes and what examples do you have ?

[–] vatsadev@alien.top 1 points 10 months ago (1 children)

OpenHermes 2.5 is the latest version, but the openHermes series has a history in ai models of being good, and I used it for some function calling, its really good

[–] ThinkExtension2328@alien.top 1 points 10 months ago

Just tried it can confirm this guy knows what he is talking about ^ , pretty great model tbh

load more comments (1 replies)