XinCui2020 issues

Repositories
Issues
Comments

Results 1 issues of


                                            XinCui2020

[QUESTION]Is there any plan to make custom_fsdp compatible with PP?

- **Tensor Parallelism (TP), Expert Parallelism (EP) and Context Parallelism (CP)**: Compatible with TP, EP and CP configurations, enabling efficient scaling of large language models. only shows support TP,EP, and...

stale