this post was submitted on 23 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I feel like this and similar questions like this should be revived monthly.
Well, it gets posted a few times a week, so it kinda is..
lol doesn’t surprise me. I’m not on here that much
Genuinely this, not in a shitty "ugh, we get asked this so much" way but in a "keeping a thread on the current recommended models at different sizes that gets refreshed frequently is a good idea, because there's just so much and it's very hard to follow sometimes for some people."
Maybe just posted as a "whats your current 7b/13b/30b/70b model? ' sticky type thing.
A moderator replied after I shared the idea three months ago but from what I know we've only got one thread from it. I still feel like having a weekly megathread (since new models come out for various reasons) would be the way to go
The plan was to keep it up as a recurring topic, but the engagement from that post, based on daily unique views and comments, was unfortunately far below what was expected. I see the feedback though, and I agree that it can be tried again.
To keep it fresh, I was thinking the sub could actively rotate two separate megathreads. One asking what model everyone is currently using for different categories and another for something else. I think it'd be great if there were themed weekly discussion posts, so if anyone has any ideas, feel free to send a modmail anytime or let me know here.
A post for this will go up soon, either this weekend or next week: "What's your current 7B/13B/33B/70B model?" That title should be easily searchable, and if the community likes this idea, the weekly megathreads could be accumulated and linked in the sidebar.
Or a leaderboard style of models so we can track it
That sounds cool. Vote on the model you are using the most that week.
You mean like this one? https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
Hey. That’s cool. Wasn’t aware of this one. This should be pinned on the top and referenced in the sidebar.
The only one that I can see is that now to track the community ones. If there is a newer model in the comments I don’t see all of them there.
Maybe some sort of hybrid?
Things move so fast I don’t mind the threads about it.
I just wish more authors on HF would write a paragraph explaining what purpose their model is intended for rather than just listing source models names that are also lacking explanation.
I think just a weekly pinned thread "what model are you using?" is good
Yeah, I kind of thought this was an automated post, not gonna lie.
We need a monthly summary, at least, but even that feels like far too long given how fast things are evolving lately. One moment, we seem to be agreed MythoMax is the bee's knees, then suddenly we've got Mythalion and a bunch of REMM variants. Suddenly, we're getting used to Mistral 7Bs giving those 13B models a run for their money, and then Yi-34B 200K and Yi-34B Chat appear out of nowhere. Decent, out-of-the-box RP mixes and fine-tunes of that surely won't be far behind....
It feels like this has all happened in the past couple of weeks.
Don't get me wrong, I love it, but I'm dizzy! Excited, but dizzy.
makes sense. the models do get updated from time to time so a monthly check if they've improved or worsened helps - just look at ChatGPT.