Parth Mannan comments

Repositories
Issues
Comments

Results 22 comments of


                                            Parth Mannan

feat: Support mcore virtual pipeline parallel

> @parthmannan do you have a different PR that supports asymmetric VPP? if so maybe we should close this and work on your PR as that covers more cases It...

[Dev] feat: hybrid-cp for dev branch (part 2)

We have `data_schedule.py` moved to https://github.com/xiaoyao0115/Megatron-LM/blob/hybrid-cp/megatron/core/datasets/data_schedule.py after part 1 PR (#2054). Can we move the changes being made to data_schedule into the same file so that we can track the...