LocalLLaMA

11 readers

4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

Qwen-72B released (huggingface.co)

submitted 2 years ago by PookaMacPhellimen@alien.top to c/localllama@poweruser.forum

39 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] candre23@alien.top 1 points 2 years ago (1 children)

we have expanded the context window length to 32K

Kinda buried the lead here. This is far and away the biggest feature of this model. Here's hoping it's actually decent as well!

[–] jeffwadsworth@alien.top 1 points 2 years ago (1 children)

Well, it depends on how well it keeps the context resolution. Did you see that comparison sheet on Claude and GPT-4? Astounding.

[–] domlincog@alien.top 1 points 2 years ago