this post was submitted on 09 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 1 year ago
MODERATORS
 

I'm trying to finetune an LLM with LoRA, using transformers' Trainer. In twenty minutes of training it didn't output any logs to screen or to disk, even though I set logging_steps to 1:

trainer = transformers.Trainer(
	...
    args = transformers.TrainingArguments(
		...
	logging_steps=1,
        logging_dir="logs",       
    ),
)

What do I need to do to see the training log? Set up any callbacks?

you are viewing a single comment's thread
view the rest of the comments
[–] SmolLM@alien.top 1 points 1 year ago

r/learnmachinelearning, stack overflow, chatgpt, literally anywhere but here