this post was submitted on 22 Nov 2023
1 points (100.0% liked)

LocalLLaMA

4 readers
4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
communick@poweruser.forum
1
Is DeepSeek Coder 1.3b meant to be this bad? (alien.top)
submitted 2 years ago by East-Awareness-249@alien.top to c/localllama@poweruser.forum
7 comments fedilink hide all child comments
 

I am using kobold.cpp and it couldn't code anything outside of hello world. Am I doing something wrong?

https://preview.redd.it/xdo6q7a25z1c1.png?width=1454&format=png&auto=webp&s=30d0eaed2c6d4d95070f2312a4bc3add0dcc2840

you are viewing a single comment's thread
view the rest of the comments
[–] LocoLanguageModel@alien.top 1 points 2 years ago

Try Setting temperature to .1

Ive had really good luck with this model for 6.7b and and 33b. The 1.3 is more of a novelty because of how fast it runs on ancient GPUs, but not nearly as good as the other 2 sizes in my attempts, though it is amazing for its size.