LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

Qwen-72B released (huggingface.co)

submitted 11 months ago by PookaMacPhellimen@alien.top to c/localllama@poweruser.forum

39 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] candre23@alien.top 1 points 11 months ago (1 children)

we have expanded the context window length to 32K

Kinda buried the lead here. This is far and away the biggest feature of this model. Here's hoping it's actually decent as well!

[–] jeffwadsworth@alien.top 1 points 11 months ago (1 children)

Well, it depends on how well it keeps the context resolution. Did you see that comparison sheet on Claude and GPT-4? Astounding.

[–] domlincog@alien.top 1 points 11 months ago