LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Would a merge between Neural Chat 7B v3.1 and OpenHermes-2.5 work? (alien.top)

submitted 11 months ago by StrangeImagination5@alien.top to c/localllama@poweruser.forum

5 comments fedilink hide all child comments

I'm curious whether that would work and someone might already try. They are both finetunes from mistral, so i would imagine. I have a feeling that this frankenmerge could produce a very good small billion parameter model that might be better than any current <=14b.

top 5 comments

sorted by: hot top controversial new old

[–] No-Link-2778@alien.top 1 points 11 months ago (1 children)

Do you think there is any scientific basis for the merge? This is medieval alchemy again.

[–] vatsadev@alien.top 1 points 11 months ago (1 children)

No its Victorian era frankenstein obvs

[–] dowell_db@alien.top 1 points 11 months ago (1 children)

Nah bro, this is the crossover with the Flintstones and the Jetsons

[–] Mescallan@alien.top 1 points 11 months ago

Wrong again, this is a peanut butter and jelly sandwhich

[–] Feeling-Currency-360@alien.top 1 points 11 months ago

Your wish has apparently been granted
https://huggingface.co/Weyaxi/OpenHermes-2.5-neural-chat-7b-v3-1-7B
https://huggingface.co/TheBloke/OpenHermes-2.5-neural-chat-7B-v3-1-7B-GGUF