LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

30,000 AI models (alien.top)

submitted 11 months ago by Creative_Bottle_3225@alien.top to c/localllama@poweruser.forum

19 comments fedilink hide all child comments

30,000 AI models

too many really. But from what I read in conversations and posts I notice one thing: you all try out Model all the time and that's fine, but I haven't yet read that anyone habitually uses one Model over others. It seems like you use one template for a few days and then start with a new one. Don't have your favorite? Which?

you are viewing a single comment's thread
view the rest of the comments

[–] ThisGonBHard@alien.top 1 points 11 months ago

You dont talk about the "usuals".

My go to models were for a long time Stable Beluga 2 13B and 70B.

Then, 13B got replaced by Minstral, 70B by LZLV, and Airoboros Yi 34B came out that worked great for me.

As a rule: 7B - CPU inferencing on 2-4 cores while using GPU.

34B and 70B, GPU inferencing, models trade blows despite size diff, as they are different base models. (Llama vs Yi).