this post was submitted on 30 Oct 2023
1 points (100.0% liked)
LocalLLaMA
3 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You might want to check out the guidance DSL. It is conceptually similar to lmql but works on a lower level than lmql.
https://github.com/guidance-ai/guidance/
The library used to be developed by Microsoft. It seems like they spun it of as a independent company or nonprofit a few months ago.