LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Brand New Mistral 16k Context Size Models got released last night from NurtureAI! (alien.top)

submitted 1 year ago by perlthoughts@alien.top to c/localllama@poweruser.forum

12 comments fedilink hide all child comments

In no particular order! Don't forget to use each of their specific prompts for the best generations!

AWQ, and GGUF also available.

https://huggingface.co/NurtureAI/zephyr-7b-beta-16k
https://huggingface.co/NurtureAI/neural-chat-7b-v3-16k
https://huggingface.co/NurtureAI/neural-chat-7b-v3-1-16k
https://huggingface.co/NurtureAI/SynthIA-7B-v2.0-16k

Have fun LocalLLaMA fam <3 ! Let us know what you find! <3

you are viewing a single comment's thread
view the rest of the comments

[–] MINIMAN10001@alien.top 0 points 1 year ago (1 children)

So assuming this release does anything at all the only thing I can think of would be that instead of "hidden size" cause being 4k giving a 4k sliding window into 32k context it would be a hidden size of 16k giving a 16k window into the 32k context.

However that's just speculation on my part because... Otherwise the release means nothing... Which would be weird.

[–] Flag_Red@alien.top 1 points 1 year ago

That's not what hidden size does.