LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Intel neural-chat-7b-v3-1 (alien.top)

submitted 11 months ago by dvanstrien@alien.top to c/localllama@poweruser.forum

14 comments fedilink hide all child comments

Has anyone explored Intel's new model yet? It's a 7B model trained on Slim Orca, which is currently the top 7B model on the HF open LLM leaderboard.

I've found other 7B models to be surprisingly helpful, especially for annotation/data extraction tasks, so I'm curious if it's worth replacing teknium/OpenHermes-2.5-Mistral-7B with this model.

you are viewing a single comment's thread
view the rest of the comments

[–] CardAnarchist@alien.top 1 points 11 months ago

I could only get pretty muddled responses from the model.

Despite seemingly having a simple prompt template I suspect I didn't enter all the data correctly into simpletavern as the outputs I was getting were similar to when I have a wrong template selected for a model.

Shrugs

If a model wants to be successful they should really pick a standard template (pref ChatML) and clearly state that's what they are using.