This is amazing. Yesterday we got Deepseek, and today we're getting Qwen. Thank you for releasing this model!
I'm looking forward to seeing comparisons
this post was submitted on 30 Nov 2023
1 points (100.0% liked)
LocalLLaMA
4 readers
4 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 2 years ago
MODERATORS
Is there any free website where I can test those Chinese models? Thanks.
https://github.com/QwenLM/Qwen
Also released was a 1.8B model.
From Bunyan Hui’s Twitter announcement:
“We are proud to present our sincere open-source works: Qwen-72B and Qwen-1.8B! Including Base, Chat and Quantized versions!
🌟 Qwen-72B has been trained on high-quality data consisting of 3T tokens, boasting a larger parameter scale and more training data to achieve a comprehensive performance upgrade. Additionally, we have expanded the context window length to 32K and enhanced the system prompt capability, allowing users to customize their own AI assistant with just a single prompt.
🎁 Qwen-1.8B is our additional gift to the research community, striking a balance between maintaining essential functionalities and maximizing efficiency, generating 2K-length text content with just 3GB of GPU memory.
We are committed to continuing our dedication to the open-source community and thank you all for your enjoyment and support! 🚀 Finally, Happy 1st birthday ChatGPT. 🎂 “
my heart skipped a beat because I thought it was Qwen-1.8T.
we have expanded the context window length to 32K
Kinda buried the lead here. This is far and away the biggest feature of this model. Here's hoping it's actually decent as well!
Well, it depends on how well it keeps the context resolution. Did you see that comparison sheet on Claude and GPT-4? Astounding.
Amazing capabilities on some benchmarks if true.
Bit disappointed by the coding performance but it is a general use case model. It's insane how good gpt 3.5 is for how fast it is.
Apparently the chat version has about 64 for humaneval.
What do these tests mean for LLM? There are many values, and I see that in most cases qwen is better than gpt4. In others it is worse or much worse
All the cases it is better than GPT-4 are benchmarks involving Chinese language. OpenAI is going to have a hard time getting access to extensive Chinese language datasets so it's not surprising a 72B model can beat GPT-4, though it's still impressive in it's own right.
big if true
Now everyone is most interested in how much better it is than 70b llama
Very nice.
I wonder what the performance degradation is after quantising. For other models some users reported that quantizing greatly affected other language capabilities and this model seems to be at leash 50% Chinese.
I've seen that ChatGLM began talking in mixed Chinese/English when asked "What tips do you have for a mountaineering trip?"
Just when I'd talked myself out of getting a second 3090
Why did so many new chinese 70b foundation models release in a day? (this one, Deepseek, XVERSE) Is there any reason they all released in such a short time?
Today is the 1 year anniversary of chatgpt.
Heh, 72b with 32k and GQA seems reasonable. Will make for interesting tunes if it's not super restricted.
The last Qwen didn't really take off as base model for further fine-tunes.
Looking forward to the results on the German data protection training benchmark ;)
can it beats 3.5-turbo?
Would it be possible to merge it with deepseek coder 35B?
Is it censored?
The first thing I looked for was the number of training tokens. I think yi34 got a lot of benefit from 3 trillion, so this model having 3 trillion bodes well.
Their own quants for transformers run:
https://huggingface.co/Qwen/Qwen-72B-Chat-Int8
https://huggingface.co/Qwen/Qwen-72B-Chat-Int4
In my informal testing, Qwen72b is quite good. I anecdotally rate it stronger than Llama 2 from the few tests that I have conducted.
What tests have you tested this in?
I'm very interested in storytelling and RP
If the US keeps going full woke and are too afraid to work as hard as possible on the LLM ecosystem, China won't wait twice before winning this battle (which is basically the 21th century battle in terms of technology)
Feels sad to see the US decline like that...
It would be great to see gguf versions. (At least, my workflow right now goes via ollama.) How are people running Qwen-72B locally right now?
China seems to be pulling ahead in the open AI race. Now it has three weights-available ~70B non-undertrained models: Qwen, Deepseek and XVerse. The west on the other hand only has Llama 1&2 (and Falcon 180B, but the UAE barely counts as "the west").
No one uses falcon lmao
There’s an audio multimodal too
I could not undestand it. Is this true audio (can differentiate a helicopter sound from a fire engine for example, or a dog bark) or it just transforms speech into text and then it feeds the model?
It’s the former. It’s looking at audio data
So you can ask it sentiment, determine if someone is giggling, crying, laughing, can maybe even detect a condescending tone or flirtatious tone etc.
Use cases??
Maybe for audio data that have both sound and words? For example if you want to summarize a concert or sth