apex
apex copied to clipboard
potential improvement in p2p communication
https://github.com/NVIDIA/apex/blob/a0f5f3ac0f6bf39feee6e60eee66ec873dc299ab/apex/transformer/pipeline_parallel/p2p_communication.py#L271 might be able to be removed after confirming https://github.com/pytorch/pytorch/pull/82450
in apex, the version check against NGC PyTorch containers (e.g. 22.08) and the released PyTorch (e.g. 1.12.1) would be sufficient