Ahmed R Almansoori comments

Repositories
Issues
Comments

Results 1 comments of


                                            Ahmed R Almansoori

[BUG] Collective group's rank is incorrect

Hello, Im helping out with this issue, i have some questions for this Currently the rank is computed in [`_get_nccl_collective_communicator`](https://github.com/alpa-projects/alpa/blob/54c585c0e897914d7078d6f0243d12a19d1733f4/alpa/collective/collective_group/nccl_collective_group.py#L401) where in it sets is like so [`actual_rank = self.rank...