this post was submitted on 28 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
New Model: Starling-LM-11B-alpha-v1 (alien.top)
submitted 1 year ago by perlthoughts@alien.top to c/localllama@poweruser.forum
44 comments fedilink hide all child comments
 

https://huggingface.co/NurtureAI/Starling-LM-11B-alpha-v1

This is Berkeley's model: Starling-LM-7B-alpha with the size of model increased to 11B from 7B.
Special thanks to user Undi95 for their mistral passthrough explanation with cg123's mergekit, Berkeley of course for Starling-LM-7B-alpha, and also everyone contributing to open source AI development.

Together we are strong!

The performance of this model will increase drastically as it is further fine tuned with the newly added layers.

AWQ version and GGUF version coming soon!

you are viewing a single comment's thread
view the rest of the comments
[–] actualopenai@alien.top 1 points 1 year ago (2 children)

what are ur settings for passthrough as im trying to make a 11b https://huggingface.co/maywell/Synatra-7B-v0.3-RP

[–] perlthoughts@alien.top 1 points 1 year ago

slices:
- sources:
- model: berkeley-nest/Starling-LM-7B-alpha
layer_range: [0, 24]
- sources:
- model: berkeley-nest/Starling-LM-7B-alpha
layer_range: [8, 32]
merge_method: passthrough
dtype: float16