LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

submitted 10 months ago by perlthoughts@alien.top to c/localllama@poweruser.forum

12 comments fedilink hide all child comments

In no particular order! Don't forget to use each of their specific prompts for the best generations!

AWQ, and GGUF also available.

Have fun LocalLLaMA fam <3 ! Let us know what you find! <3

you are viewing a single comment's thread
view the rest of the comments

[–] permalip@alien.top 1 points 10 months ago

There is nothing "true" context length about MistralLite. You are essentially removing the sliding window by doing what Amazon or Yarn is doing.