AungV issues

Repositories
Issues
Comments

Results 1 issues of


                                            AungV

AttributeError: module 'torch.distributed' has no attribute '_all_gather_base'

https://github.com/NVIDIA/apex/blob/6a40a0ad9ff3d6ebea715cf28faf39792312acbf/apex/transformer/utils.py#L10 when i use FusedAdam in torch1.8, there is no all_gather_into_tensor or _all_gather_base in dir(torch.distributed).