metaseq icon indicating copy to clipboard operation
metaseq copied to clipboard

Remove Megatron dependency - move entirely to Fairscale

Open suchenzang opened this issue 1 year ago • 1 comments

This is to look into whether or not we can remove our Megatron dependency and rely entirely on our Fairscale dependency (model parallelism implementation seems to be identical between the two).

suchenzang avatar Jan 24 '23 17:01 suchenzang