wang fei issues

Repositories
Issues
Comments

Results 1 issues of


                                            wang fei

Integrates DeepSpeed-Ulysses sequence parallel, enabling efficient training of large language models with ultra-long sequences.

### Reminder - [x] I have read the above rules and searched the existing issues. ### System Info This project is an extension of [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory) that integrates DeepSpeed-Ulysses sequence parallel...

bug

pending