LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Is DeepSeek Coder 1.3b meant to be this bad? (alien.top)

submitted 11 months ago by East-Awareness-249@alien.top to c/localllama@poweruser.forum

7 comments fedilink hide all child comments

I am using kobold.cpp and it couldn't code anything outside of hello world. Am I doing something wrong?

https://preview.redd.it/xdo6q7a25z1c1.png?width=1454&format=png&auto=webp&s=30d0eaed2c6d4d95070f2312a4bc3add0dcc2840

you are viewing a single comment's thread
view the rest of the comments

[–] East-Awareness-249@alien.top 1 points 11 months ago

It is the instruct model. You can see underneath the prompt box that it's the deepseek-coder-1.3b-instruct_Q5_K_s model. I used the prompting template in the model, and it slightly improved answers.

But if I ask if to write some code, it almost never does and says something gibberish.

Does your GPU/CPU quality affect the AI's output? My device is potato.