Hongxin Liu issues

Repositories
Issues
Comments

Results 24 issues of


                                            Hongxin Liu

[WIP][shardformer] update modeling to fit colo attention

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

[compatibility] support torch 2.2

![Image](https://github.com/hpcaitech/ColossalAI/assets/23111350/d0397c13-f1f0-43df-b84b-bf3942829bee)

bug

[chat] add distributed impl

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

[misc] update torch version

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...