Bing Bo
Results
2
comments of
Bing Bo
@sxthunder I have similar loss explode problems when using different GPU nums, do you solve them?
> @sdws258 Try removing this line > > https://github.com/thu-coai/DA-Transformer/blob/8ef9c8f43f239d7004be004d5d2778cf080d4b2f/fs_plugins/custom_ops/dag_loss.py#L54 > > If it works well, I will update a patch to fix the issue It looks good to me