this post was submitted on 22 Nov 2023
1 points (100.0% liked)

LocalLLaMA

4 readers
4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
communick@poweruser.forum
1
Intel neural-chat-7b-v3-1 (alien.top)
submitted 2 years ago by dvanstrien@alien.top to c/localllama@poweruser.forum
14 comments fedilink hide all child comments
 

Has anyone explored Intel's new model yet? It's a 7B model trained on Slim Orca, which is currently the top 7B model on the HF open LLM leaderboard.

I've found other 7B models to be surprisingly helpful, especially for annotation/data extraction tasks, so I'm curious if it's worth replacing teknium/OpenHermes-2.5-Mistral-7B with this model.

you are viewing a single comment's thread
view the rest of the comments
[–] vaibhavsxn@alien.top 1 points 2 years ago

I find it extremely slow on 2x A6000 gpus.