this post was submitted on 30 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Qwen-72B released (huggingface.co)
submitted 1 year ago by PookaMacPhellimen@alien.top to c/localllama@poweruser.forum
39 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] ambient_temp_xeno@alien.top 1 points 1 year ago

The first thing I looked for was the number of training tokens. I think yi34 got a lot of benefit from 3 trillion, so this model having 3 trillion bodes well.