LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

What are your fav questions to eval a new LLM? (alien.top)

submitted 11 months ago by dulldata@alien.top to c/localllama@poweruser.forum

17 comments fedilink hide all child comments

Every other day, there's a new LLM, Do you have a set of questions to test them?

you are viewing a single comment's thread
view the rest of the comments

[–] Zemanyak@alien.top 1 points 11 months ago (1 children)

Yeah, I have 10 questions to evaluate how the LLM responds to my specific needs (translation, coding, mail redaction, explanation, summarization and a bit of role-play). I'm not really impressed unless it provides answers in proper Malagasy. Bonus point (extra question) if it's uncensored.

[–] Embrace-Mania@alien.top 1 points 11 months ago

I can't post my Eval questions to test the Ethics of my LLM to Reddit. I'll get banned lol