LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

What is the best code generation model aside from gpt-4? (alien.top)

submitted 1 year ago by Charuru@alien.top to c/localllama@poweruser.forum

23 comments fedilink hide all child comments

Using and losing lots of money on gpt-4 ATM, it works great but for the amount of code I'm generating I'd rather have a self hosted model. What should I look into?

you are viewing a single comment's thread
view the rest of the comments

[–] woodmastr@alien.top 1 points 1 year ago (2 children)

You might want to check EvalPlus Leaderboard

#Model Size pass@1

1🥇GPT-4 (May 2023)🗒️N/A⚡76.8

2🥈DeepSeek-Coder-instruct🗒️33B⚡72.6

3🥉DeepSeek-Coder-instruct🗒️6.7B⚡70.1

[–] Zemanyak@alien.top 1 points 1 year ago

Great board. I wish they had Phind 7 or whatever they use on their live website.

[–] KOTNcrow@alien.top 1 points 1 year ago

That board is in serious need of an update, check the Yi-34b model, very impressive. Dolphin 2.2 Yi 34b is a variant I cant wait to try.