this post was submitted on 20 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The correct answer here is reading logprobs/logits over the true/false tokens after parsing the input.
Using a grammar is overkill and a classification model might not get you the fidelity you want.