InternEvo

InternEvo copied to clipboard

### 描述该功能 目前仓库对pip安装的依赖库版本有严格的指定，对于广泛的使用会有一定的不便。需要逐步放松对应的限制 ### 是否希望自己实现该功能？ - [ ] 我希望自己来实现这一功能，并向 InternLM 贡献代码！

zhangxc11

[Feature] Partially frozen model support

2

### Describe the feature Current implementation does not support partially training, i.e., part of the model parameters are frozen. If I understand it correctly, the assertion around line 584 in...

scenarios

### Describe the feature 在目前的情形下，pipeline parallel会在第一份数据进入时固定logits等的形状，但事实上，下游任务中很多时候最好能支持变长以节省算力，而不是进行过多的padding。 ### Will you implement it? - [ ] I would like to implement this feature and create a PR!

Pryest

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand...

lucasleesw

## Motivation - **support pip install**: one-stop installation via python packaging - **easier API**: from high-level 'TrainerBuilder', to mid-level ZeRO/FSDP/TP/PP/WP/SP/CP/EP parallelism, and low-level ops - **FSDP+EP**: support FSDP working with...

zigzagcai

### Describe the feature 如题 ### Will you implement it? - [ ] I would like to implement this feature and create a PR!

lynshwoo2022

Test for SC++ implements on NPU, bug fixes

SweetStanleyL

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand...

blankde

add non p2p communication for pipeline scheduling

mwiacx

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand...

sallyjunjun