EnergonAI icon indicating copy to clipboard operation
EnergonAI copied to clipboard

[Feature]: Automatic Pipeline Parallelism

Open dujiangsu opened this issue 2 years ago • 0 comments

Describe the feature: We are going to introduce the automated pipeline parallelism feature into EnergonAI, which hopes that users only need to specify some simple arguments and achieve the pipeline parallelism. With torch.fx, here the pipelinable directory is with functions that can split a model into multiple submodules.

Difficulty:

  1. Use meta device in fx.GraphModule generation to reduce peak memory usage.
  2. auto_pipeline_wrapper.py is not that automated.

dujiangsu avatar Jun 08 '22 09:06 dujiangsu