Becomefilthyrich

joined 2 years ago

[D] What is the motivation for parameter-efficient fine tuning if there's no significant reduction in runtime or GPU memory usage? in c/machinelearning@academy.garden

[–] Becomefilthyrich@alien.top 1 points 2 years ago

Have extensively working with this past 6 months , specifically llm and whisper finetuning

Lora defenitly gives a significant boost in training speed as well as a massive reduction in mem requirements