Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 1 year ago

MODERATORS

communick@academy.garden

[D] Do you obsessively watch your models train? (alien.top)

submitted 11 months ago by TehDing@alien.top to c/machinelearning@academy.garden

60 comments fedilink hide all child comments

I find myself watching tensorboard more than working- just wondering if others who have fallen into this pattern have words of advice wrt productivity

you are viewing a single comment's thread
view the rest of the comments

[–] rwl4z@alien.top 1 points 11 months ago

I do LoRA training for most of my stuff as of late, so most of my experiments are in minutes, or maybe sometimes hours, not days. So yeah, I tend to leave the terminal visible. I've been experimenting with narrowing the LoRA alpha lately with promising results, so I'm even more glued to the eval/loss vs train/loss so I don't waste hours on a doomed experiment.

It kind of feels like I'm baking bread or something, with a childlike excitement when it's ready.