this post was submitted on 12 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
So it turns out you just need to train on GPT output for better benchmarks lol. Not to say there's a chance GPT models are contaminated with benchmark test data too. "Distillation" went a little too far. Easy VC money though, I would do the same.