this post was submitted on 04 Dec 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
 

I have been using this as daily driver for a few days, very good, i never thought 7B model can achieve this level of coding + chat
https://huggingface.co/TheBloke/OpenHermes-2.5-neural-chat-7B-v3-1-7B-GGUF

you are viewing a single comment's thread
view the rest of the comments
[โ€“] GasBond@alien.top 1 points 9 months ago (1 children)

TheBloke openhermes 2.5 mistral 16k 7B q5_k_m gguf. what about this? anyone using this model?

[โ€“] LoSboccacc@alien.top 1 points 9 months ago

I am using it, my favorite finetune so far, however, ignore the instructions to use chatml prompt formattig and use instead vicuna, with USER: and ASSISTANT:, possibly one of the best model I've seen for long conversation