this post was submitted on 18 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Best choise to continue AI coding without ChatGPT Plus? (alien.top)
submitted 1 year ago by AapoL092@alien.top to c/localllama@poweruser.forum
30 comments fedilink hide all child comments
 

Well the code quality has gotten pretty bad so I think it's time to cancel my subscription to ChatGPT Plus. I have an RX 6600 and an GTX 1650 Super so I don't think local models are a possible choise (at least for the same style of coding that is done with GPT-4). But I decided to post here anyway since you guys are very knowledgeable. I was looking at cursor.ai and it seemed pretty good. I don't know how good it's now since OpenAI has decreased the performance of GPT-4 but I have heard that the API is still ok. Also there is refract which could be a similar choise too. What do you recommend? I do coding in mostly Python and sometimes C++.

you are viewing a single comment's thread
view the rest of the comments
[–] Scary-Knowledgable@alien.top 1 points 1 year ago (3 children)

Deepseek Coder 33B worked well for me, I asked it to make the game snake and it did it the first time with the 4bit GPTQ - https://huggingface.co/TheBloke/deepseek-coder-33B-instruct-GPTQ

Other models are available to run on CPU/GPU - https://huggingface.co/models?search=deepseek%2033b

[–] AapoL092@alien.top 1 points 1 year ago

What specs? Didn't have enough memory to run it. I have an RX 6600 and a Ryzen 5 5600x also 16gb of ram.

[–] You_Wen_AzzHu@alien.top 1 points 1 year ago

Game Snake will be included in all models.

[–] kingp1ng@alien.top 1 points 1 year ago (2 children)

What UI do you use with Deepseek Coder? I need one that can format markdown text well.

[–] Scary-Knowledgable@alien.top 1 points 1 year ago

I use oobabooga, I'm actually testing out using it with Language Agent Tree Search to see if it can make better outputs -https://github.com/andyz245/LanguageAgentTreeSearch