LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

Would a merge between Neural Chat 7B v3.1 and OpenHermes-2.5 work? (alien.top)

submitted 10 months ago by StrangeImagination5@alien.top to c/localllama@poweruser.forum

5 comments fedilink hide all child comments

I'm curious whether that would work and someone might already try. They are both finetunes from mistral, so i would imagine. I have a feeling that this frankenmerge could produce a very good small billion parameter model that might be better than any current <=14b.

you are viewing a single comment's thread
view the rest of the comments

[–] No-Link-2778@alien.top 1 points 10 months ago (1 children)

Do you think there is any scientific basis for the merge? This is medieval alchemy again.

[–] vatsadev@alien.top 1 points 9 months ago (1 children)

No its Victorian era frankenstein obvs

[–] dowell_db@alien.top 1 points 9 months ago (1 children)

Nah bro, this is the crossover with the Flintstones and the Jetsons

[–] Mescallan@alien.top 1 points 9 months ago

Wrong again, this is a peanut butter and jelly sandwhich