Pavel issues

Repositories
Issues
Comments

Results 1 issues of


                                            Pavel

Deadlock in reduce_dict when targets are empty on some ranks

**Describe the bug** When training a model with contrastive denoising (DN) enabled in a DistributedDataParallel (DDP) setting, a deadlock can occur at reduce_dict(loss_dict) if some ranks receive empty targets (i.e.,...