rvitor

joined 10 months ago
sorted by: new top controversial old
When training an LLM how do you decide to use a 7b, 30b, 120b, etc model (assuming you can run them all)? in c/localllama@poweruser.forum
[–] rvitor@alien.top 1 points 10 months ago

for training sometimes is better to pick a small model to do some tests and get faster feedback, then you can train in a larger model if you want to, and see how it goes.