this post was submitted on 13 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
What is the best code generation model aside from gpt-4? (alien.top)
submitted 10 months ago by Charuru@alien.top to c/localllama@poweruser.forum
23 comments fedilink hide all child comments
 

Using and losing lots of money on gpt-4 ATM, it works great but for the amount of code I'm generating I'd rather have a self hosted model. What should I look into?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] woodmastr@alien.top 1 points 10 months ago (2 children)

You might want to check EvalPlus Leaderboard

#Model Size pass@1

1๐Ÿฅ‡GPT-4 (May 2023)๐Ÿ—’๏ธN/Aโšก76.8

2๐ŸฅˆDeepSeek-Coder-instruct๐Ÿ—’๏ธ33Bโšก72.6

3๐Ÿฅ‰DeepSeek-Coder-instruct๐Ÿ—’๏ธ6.7Bโšก70.1

[โ€“] Zemanyak@alien.top 1 points 10 months ago

Great board. I wish they had Phind 7 or whatever they use on their live website.

[โ€“] KOTNcrow@alien.top 1 points 10 months ago

That board is in serious need of an update, check the Yi-34b model, very impressive. Dolphin 2.2 Yi 34b is a variant I cant wait to try.