LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Quantization of the newly released Swedish Gpt-sw3? (alien.top)

submitted 11 months ago by AssociationNo8626@alien.top to c/localllama@poweruser.forum

0 comments fedilink hide all child comments

Does anyone have any plans to quantizie any of the newly relased Gtp-sw3 models?

Or if there is a guide (very detailed) how to do it. Iam not very tech savy so what i have found/googled so far, is above my level. Which is quit low to be honest...

Is there anyone planing to quantizie these models or willing to do it?

The modelI Iam most interested in is the 20B instruct model. (Guff or AWQ).

https://huggingface.co/AI-Sweden-Models/gpt-sw3-20b-instruct

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here