eggandbacon_0056

joined 1 year ago
sorted by: new top controversial old
Could multiple 7b models outperform 70b models? in c/localllama@poweruser.forum
[–] eggandbacon_0056@alien.top 1 points 11 months ago

Still waiting for someone to use actual ensemble models and inference over all models and pick max or similar

Orca 2: Teaching Small Language Models How to Reason in c/localllama@poweruser.forum
Finetuning LLMs: Does it add new knowledge to model or not? in c/localllama@poweruser.forum
Finetuning LLMs: Does it add new knowledge to model or not? in c/localllama@poweruser.forum
[–] eggandbacon_0056@alien.top 1 points 1 year ago

Obviously it is adding knowledge.

The training is done the same as for the preparing with adjusted hyper parameters. ...