Make sure you are using the Codellama Instruct preset. Also, work on your prompting:
"You are tasked to write a python script that takes an email address...."
this post was submitted on 14 Nov 2023
1 points (100.0% liked)
LocalLLaMA
3 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 1 year ago
MODERATORS
Try DeepSeek Coder, the 6.7b is so much better than CodeLlama any of them
Also i'd give the new openchat 3.5, if the benchmarks are indeed correct then it's the best 7B model so far (altough there are so many of them that i might be wrong, but it's better than base mistral 7B)
I'll be honest- my expectation of a 7b q6 model to generate a usable code block would be pretty darn low. I use 7b as a small code snippet analyzer in Continue.dev, but I'm not sure I'd really put a lot of faith in any 7b to do that task. The CodeLlama 34b models are actually pretty decent, though; I use the 34b q8 of CodeFuse, Codebooga and Phind v2 and they are all pretty decent.