LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

submitted 11 months ago by Significant_Focus134@alien.top to c/localllama@poweruser.forum

3 comments fedilink hide all child comments

Warning, this is still work in progress.

First version of 7b Polish LLM finetuned using custom data in Polish language.

As a base model I used uncensored https://huggingface.co/ehartford/dolphin-2.1-mistral-7b so Dolphin "personality" should also be there.

It was trained using 4K context in ChatML format. All done on a single 4090 for multiple days.

you are viewing a single comment's thread
view the rest of the comments

[–] paryska99@alien.top 1 points 11 months ago

I hope we can get quantized gguf soon from the legendary TheBloke