this post was submitted on 13 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Using and losing lots of money on gpt-4 ATM, it works great but for the amount of code I'm generating I'd rather have a self hosted model. What should I look into?

you are viewing a single comment's thread
view the rest of the comments
[–] DifferentPhrase@alien.top 1 points 1 year ago (4 children)

As far as self hosted models go, deepseek-coder-33B-instruct is the best model I have found for coding. Anecdotally it seems more coherent and gives better results than Phind-CodeLlama-34B-v2.

[–] yonomono@alien.top 1 points 1 year ago (1 children)

Think this would be good-enough/suitable to use with AutoGPT/BabyAGI type situations? This is my main use-case, for bulk inspiration if not productivity. The API's can get expensive if left on full-automatic overnight.

[–] nishant299@alien.top 1 points 1 year ago

I wanna do something similar, please let me know what conclusion you reach to

load more comments (2 replies)