this post was submitted on 20 Nov 2023
1 points (100.0% liked)
LocalLLaMA
3 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Officially and cleanly, they wouldn't get a lot of openAI's data that way. Especially the parameters for the new models and a lot of the best training data has not been shared with MS yet, and unless an employee brings that through the back door, they won't ever get it.
Yeah but it's 50% off plus the cost of training GPT-4 which is not gonna be 13B.