this post was submitted on 13 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
What is the best code generation model aside from gpt-4? (alien.top)
submitted 1 year ago by Charuru@alien.top to c/localllama@poweruser.forum
23 comments fedilink hide all child comments
 

Using and losing lots of money on gpt-4 ATM, it works great but for the amount of code I'm generating I'd rather have a self hosted model. What should I look into?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] woodmastr@alien.top 1 points 1 year ago (2 children)

You might want to check EvalPlus Leaderboard

#Model Size pass@1

1๐Ÿฅ‡GPT-4 (May 2023)๐Ÿ—’๏ธN/Aโšก76.8

2๐ŸฅˆDeepSeek-Coder-instruct๐Ÿ—’๏ธ33Bโšก72.6

3๐Ÿฅ‰DeepSeek-Coder-instruct๐Ÿ—’๏ธ6.7Bโšก70.1

[โ€“] Zemanyak@alien.top 1 points 1 year ago

Great board. I wish they had Phind 7 or whatever they use on their live website.

load more comments (1 replies)