ai-toolkit
ai-toolkit copied to clipboard
Any quick way to find the average loss of the last 'n' cycles (to track progress without using TensorBoard)
Apologies... not a bug.
I think it would be useful if the tool could calculate the average loss of the last 'n' cycles (e.g. 250, i.e. 'n' could be = "Save Every").
I can see the loss for each cycle in the log.txt, but I have to calculate the average manually, whereas it would be great if it were saved in the log or incorporated in the filename of the saved loras, e.g. "LoraName_000000750_2.695e-01.safetensors".