Community to discuss about Llama, the family of large language models created by Meta AI.
I've been using playground since march. Pay per usage, model configuration and your data is not used for training. Some months I pay 30 bucks, some 5. It depends on the model and amount.
The interface is a bit worse as it's obviously not made for consumers but it's like the most obvious "cheat code" many don't realise.
Find here: https://platform.openai.com/playground?mode=chat&model=gpt-4-1106-preview
I second this. I paid 5 bucks one month ago and to this day I only used $0.63!
what do you think are the best settings for coding?
Code quality gotten pretty bad?
Can you elaborate a bit? Im also using it for py and cpp.
I think that the key to using any LLM for writing code is to not overwhelm the model with too many asks or feeding it too much code at once, even if the context window is large. Baby steps and EXTREMELY clear requirements for each one of those steps are absolutely critical to getting the most out of any of these models.
One hack I've found is to have the LLM (or yourself) comment your code very explicitly. When you feed it back, the improvement is substantial.
Take a look at Phind.com. They use the web to enhance their model's answers. That means that you can get up to date information on APIs instead of relying on the data with a cutoff of 2021 or 2022. You can use their in house Phind V8 model for free, but if you want to use GPT4, you get 10 tries a day. If you want more, they have paid plans. They recently announced that their free V8 model was as good as GPT4, but other people here have disagreed with them. I have never used GPT4, but their free Phind model was better than anything local we have.
Well cutoff of latest version of GPT4 is at April 2023, so not really relevant now. But have to admit that Phind model is really impressive
Nice, I didn't know that.
Find is really great in specific instances. As soon as I give it a bunch of code with any complexity in requests, it falls apart and does much worse than chatgpt.
Deepseek Coder 33B worked well for me, I asked it to make the game snake and it did it the first time with the 4bit GPTQ - https://huggingface.co/TheBloke/deepseek-coder-33B-instruct-GPTQ
Other models are available to run on CPU/GPU - https://huggingface.co/models?search=deepseek%2033b
What UI do you use with Deepseek Coder? I need one that can format markdown text well.
use LM Studio
Not FOSS
I use oobabooga, I'm actually testing out using it with Language Agent Tree Search to see if it can make better outputs -https://github.com/andyz245/LanguageAgentTreeSearch
Game Snake will be included in all models.
What specs? Didn't have enough memory to run it. I have an RX 6600 and a Ryzen 5 5600x also 16gb of ram.
also check https://coder.deepseek.com/chat, pretty large context and blazing fast.
i’m sorry but why the fortnite skin😭😭😭
What vscode extensions are you using with these local models?
I'm not using anything. I have so far just used the cursor.ai vscode fork which has a cool system for using GPT-4 or 3.5.
I personally use one called Continue. It's amazing!
Try Pieces, it is fo free. Its has a coding assistant (you can choose between different models) that you can feed with websites, files and snippets. The assistant is specialized for coding and deliveres really good results for me and when given additional context through files or website content it follows the instructions astonishingly well.
It is much more than just the coding assistant though, it is a tool to quick capture code snippets and leverage them. It also has integrations for the browser, vs code, jetbrains and obsidian.
Can only recommend it!
Looks really nice - I watched the video demo and I can't say that my coding experience really calls for any of the things in the demo. Most of what I deal with is managing integration of a large set of data models. The actual coding is the easy part, figuring out what to code is the hard part.
Switch to paid api, install vs code, and a gpt integration plugin, you can use the old gpt4 full version, and you can also combine that with free services like code whisperer for basic completion so you only pay for where you're getting the most value out of.
i use both phind.com and poe.com (claude) , they are nice for now since they are free
claude is dogshit for code generation from my experience
Hey, another bot replied to you; /u/thumbsdrivesmecrazy is a click-farming spam bot. Please downvote its comment and click the report button, selecting Spam then Link farming.
With enough reports, the reddit algorithm will suspend this spammer.
!^(If this message seems out of context, it may be because thumbsdrivesmecrazy is farming karma and may edit their comment soon with a link)!<