FreezeOut
FreezeOut copied to clipboard
Max iterations is set independent from the dataset
Thank you for your contribution. In the line below, the total iterations per epoch is assumed to be 1000 (regardless of the batch size or dataset). It is not clear which dataset or batch_size this number assumes.
m.max_j = self.epochs * 1000 * m.lr_ratio I assume this number would be replaced by total iterations per epoch for a different dataset or batch_size. Correct me if I am wrong please.