LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Best choise to continue AI coding without ChatGPT Plus? (alien.top)

submitted 1 year ago by AapoL092@alien.top to c/localllama@poweruser.forum

30 comments fedilink hide all child comments

Well the code quality has gotten pretty bad so I think it's time to cancel my subscription to ChatGPT Plus. I have an RX 6600 and an GTX 1650 Super so I don't think local models are a possible choise (at least for the same style of coding that is done with GPT-4). But I decided to post here anyway since you guys are very knowledgeable. I was looking at cursor.ai and it seemed pretty good. I don't know how good it's now since OpenAI has decreased the performance of GPT-4 but I have heard that the API is still ok. Also there is refract which could be a similar choise too. What do you recommend? I do coding in mostly Python and sometimes C++.

you are viewing a single comment's thread
view the rest of the comments

[–] Entire_Cheetah_7878@alien.top 1 points 1 year ago

I think that the key to using any LLM for writing code is to not overwhelm the model with too many asks or feeding it too much code at once, even if the context window is large. Baby steps and EXTREMELY clear requirements for each one of those steps are absolutely critical to getting the most out of any of these models.

One hack I've found is to have the LLM (or yourself) comment your code very explicitly. When you feed it back, the improvement is substantial.