this post was submitted on 01 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 11 months ago
MODERATORS
 

Hi! I wanted to share LangCheck, an open source toolkit to evaluate LLM applications (GitHub, Quickstart).

It already supports English and Japanese text, and more languages soon – contributions welcome!

Core functionality:

  • langcheck.metrics – metrics to evaluate quality & structure of LLM-generated text
  • langcheck.plot – interactive visualizations of text quality
  • langcheck.augment – text augmentations to perturb prompts, references, etc (coming soon)

Super open to feedback & curious how other people think about evaluation for LLM apps.

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here