Shuo Zhang
Results
2
issues of
Shuo Zhang
**Describe the bug** when I use pipeline parallelism and ZeRo-1 offload at the same time, there will be an error: ``` │ /mnt/petrelfs/zhangshuo/miniconda3/envs/dl/lib/python3.9/site-packages/deepspeed/runtime/zero/st │ │ age_1_and_2.py:485 in __init__ │ │...
bug
training
### Describe the feature internlm2-1.8b finetuning config is missing ### Will you implement it? - [X] I would like to implement this feature and create a PR!
enhancement