this post was submitted on 26 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

I'm confused by all these prefixes that appear in the finetunes of base models. Is there a glossary of all these words and similar ones?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] vicks9880@alien.top 1 points 11 months ago (1 children)

These are just names, LLaMA originally meant ( Large language model Meta AI), but it appears that its also the name of South American animal, thus creative people of internet who download those weights, fine-tuned it and published it with the other animals of same family like alpaca, vicuna, dalai (llama) etc.

There are more important information in these model names, which are suffix, like parameter counts13B, quantization methods GGUF/GGML, fine-tuning techniques like LoRA, fine-tuning parameters like Q6_K_M etc are used.

[โ€“] prtt@alien.top 1 points 11 months ago

the other animals of same family like alpaca, vicuna, dalai (llama)

One of these is definitely not like the others.