this post was submitted on 15 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Brand New Mistral 16k Context Size Models got released last night from NurtureAI! (alien.top)
submitted 11 months ago by perlthoughts@alien.top to c/localllama@poweruser.forum
12 comments fedilink hide all child comments
 

In no particular order! Don't forget to use each of their specific prompts for the best generations!

AWQ, and GGUF also available.

https://huggingface.co/NurtureAI/zephyr-7b-beta-16k
https://huggingface.co/NurtureAI/neural-chat-7b-v3-16k
https://huggingface.co/NurtureAI/neural-chat-7b-v3-1-16k
https://huggingface.co/NurtureAI/SynthIA-7B-v2.0-16k

Have fun LocalLLaMA fam <3 ! Let us know what you find! <3

you are viewing a single comment's thread
view the rest of the comments
[–] MugosMM@alien.top 0 points 11 months ago (1 children)

NurtureAI extended the context size to 16k

[–] vasileer@alien.top 0 points 11 months ago (1 children)
[–] MINIMAN10001@alien.top 0 points 11 months ago (1 children)

So assuming this release does anything at all the only thing I can think of would be that instead of "hidden size" cause being 4k giving a 4k sliding window into 32k context it would be a hidden size of 16k giving a 16k window into the 32k context.

However that's just speculation on my part because... Otherwise the release means nothing... Which would be weird.

[–] Flag_Red@alien.top 1 points 11 months ago

That's not what hidden size does.