this post was submitted on 23 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

I like 7b but 13b like orca2 are better, no? What is the best?

you are viewing a single comment's thread
view the rest of the comments
[–] reggiestered@alien.top 1 points 11 months ago (7 children)

I feel like this and similar questions like this should be revived monthly.

[–] TheTerrasque@alien.top 1 points 11 months ago (1 children)

Well, it gets posted a few times a week, so it kinda is..

[–] reggiestered@alien.top 1 points 11 months ago

lol doesn’t surprise me. I’m not on here that much

[–] GreenTeaBD@alien.top 1 points 11 months ago (1 children)

Genuinely this, not in a shitty "ugh, we get asked this so much" way but in a "keeping a thread on the current recommended models at different sizes that gets refreshed frequently is a good idea, because there's just so much and it's very hard to follow sometimes for some people."

Maybe just posted as a "whats your current 7b/13b/30b/70b model? ' sticky type thing.

[–] rainbowkarin@alien.top 1 points 11 months ago (1 children)

A moderator replied after I shared the idea three months ago but from what I know we've only got one thread from it. I still feel like having a weekly megathread (since new models come out for various reasons) would be the way to go

[–] Civil_Collection7267@alien.top 1 points 11 months ago (2 children)

The plan was to keep it up as a recurring topic, but the engagement from that post, based on daily unique views and comments, was unfortunately far below what was expected. I see the feedback though, and I agree that it can be tried again.

To keep it fresh, I was thinking the sub could actively rotate two separate megathreads. One asking what model everyone is currently using for different categories and another for something else. I think it'd be great if there were themed weekly discussion posts, so if anyone has any ideas, feel free to send a modmail anytime or let me know here.

A post for this will go up soon, either this weekend or next week: "What's your current 7B/13B/33B/70B model?" That title should be easily searchable, and if the community likes this idea, the weekly megathreads could be accumulated and linked in the sidebar.

[–] mutatedbrain@alien.top 1 points 11 months ago (2 children)

Or a leaderboard style of models so we can track it

[–] RelevantFoundation14@alien.top 1 points 11 months ago

That sounds cool. Vote on the model you are using the most that week.

[–] CalangoVelho@alien.top 1 points 11 months ago (1 children)
[–] mutatedbrain@alien.top 1 points 11 months ago

Hey. That’s cool. Wasn’t aware of this one. This should be pinned on the top and referenced in the sidebar.

The only one that I can see is that now to track the community ones. If there is a newer model in the comments I don’t see all of them there.

Maybe some sort of hybrid?

[–] Dankmre@alien.top 1 points 11 months ago

Things move so fast I don’t mind the threads about it.

[–] PaulCoddington@alien.top 1 points 11 months ago

I just wish more authors on HF would write a paragraph explaining what purpose their model is intended for rather than just listing source models names that are also lacking explanation.

[–] Kep0a@alien.top 1 points 11 months ago

I think just a weekly pinned thread "what model are you using?" is good

[–] smile_e_face@alien.top 1 points 11 months ago

Yeah, I kind of thought this was an automated post, not gonna lie.

[–] BoshiAI@alien.top 1 points 11 months ago

We need a monthly summary, at least, but even that feels like far too long given how fast things are evolving lately. One moment, we seem to be agreed MythoMax is the bee's knees, then suddenly we've got Mythalion and a bunch of REMM variants. Suddenly, we're getting used to Mistral 7Bs giving those 13B models a run for their money, and then Yi-34B 200K and Yi-34B Chat appear out of nowhere. Decent, out-of-the-box RP mixes and fine-tunes of that surely won't be far behind....

It feels like this has all happened in the past couple of weeks.
Don't get me wrong, I love it, but I'm dizzy! Excited, but dizzy.

[–] rookierook00000@alien.top 1 points 11 months ago

makes sense. the models do get updated from time to time so a monthly check if they've improved or worsened helps - just look at ChatGPT.