LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

What prompts/questions do you use to test a model’s capabilities? Ideally ones that aren’t included in their training data. (alien.top)

submitted 10 months ago by sardoa11@alien.top to c/localllama@poweruser.forum

7 comments fedilink hide all child comments

Looking for some good prompts to get an idea of just how smart a model is.

With constant new releases, it’s not always feasible to sit there and have a long conversation, although that is the route I generally prefer.

Thanks in advance.

you are viewing a single comment's thread
view the rest of the comments

[–] ntn8888@alien.top 1 points 10 months ago

I've used gpt4 to help write articles for my blog. So I just picked some of the good articles that it wrote (eg Lutris game manager) and prompt the testing one to write (800 words) and then compare. This has worked really well for me. Vicuna 33b was the best alternative I've found in my small tests in creative writing.. Although I cant locally host it on my PC :/