this post was submitted on 09 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 1 year ago
MODERATORS
 

I'm trying to finetune an LLM with LoRA, using transformers' Trainer. In twenty minutes of training it didn't output any logs to screen or to disk, even though I set logging_steps to 1:

trainer = transformers.Trainer(
	...
    args = transformers.TrainingArguments(
		...
	logging_steps=1,
        logging_dir="logs",       
    ),
)

What do I need to do to see the training log? Set up any callbacks?

top 1 comments
sorted by: hot top controversial new old
[–] SmolLM@alien.top 1 points 1 year ago

r/learnmachinelearning, stack overflow, chatgpt, literally anywhere but here