this post was submitted on 28 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
What are your fav questions to eval a new LLM? (alien.top)
submitted 11 months ago by dulldata@alien.top to c/localllama@poweruser.forum
17 comments fedilink hide all child comments
 

Every other day, there's a new LLM, Do you have a set of questions to test them?

you are viewing a single comment's thread
view the rest of the comments
[–] Qaziquza1@alien.top 1 points 11 months ago
  1. What is a potato?
  2. What's the area of a hallway that's 5m by 1m?
  3. sina toki ala toki e toki pona (toki pona for "do you speak toki pona?". It's a good litmus for multilingual capabilities and size/variety of training data.
  4. If the above goes through: sina sona e toki Tosi anu seme? ("Do you speak German?" in toki pona. I've yet to find a model which gets this right.)
  5. Generate a bash script to create 10 files, with the names A1.txt through A10.txt
  6. Sprichst du Deutsch? ("Do you speak German?" In German.)

It's a bit random, but it gets it done.