Yike Zhang

Zipformer does not converge when trained on multi hosts

11

Hi, I integrate the codes of Zipformer as well as ScaleAdam/Eden Optimizer to my projects and reach satisfactory results when I train the model using 8 GPUs on a single...