this post was submitted on 10 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Introducing Jais 30B, the latest open source Arabic-English model developed by Core42 & Cerebras (www.g42.ai)
submitted 10 months ago by maroule@alien.top to c/localllama@poweruser.forum
5 comments fedilink hide all child comments
top 5 comments
sorted by: hot top controversial new old
[–] maroule@alien.top 1 points 10 months ago

Introducing Jais 30B, the latest open source Arabic-English model developed by Core42 & Cerebras. It sets a new benchmark in Arabic LLM accuracy and outperforms Llama 30B in English. Trained on 16x Cerebras CS-2s using only data parallelism.

[–] mcmoose1900@alien.top 1 points 10 months ago (1 children)

There's been lots of Arabic investment in Cerebras:

https://www.datacenterdynamics.com/en/news/cerebras-signs-900m-deal-with-uaes-g42-to-build-up-to-nine-ai-supercomputers/

They're probably training a lot more than that with all the CS-2s they are shipping.

[–] MoneroBee@alien.top 1 points 10 months ago (1 children)

Yeah you're right, Falcon also Arabian.

[–] Amgadoz@alien.top 1 points 10 months ago

I wouldn't call it "Arabic". It doesn't handle Arabic text well.

[–] SG14140@alien.top 1 points 10 months ago

is there 13 b ?