ColossalAI

ColossalAI copied to clipboard

…allelism ## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format:...

KKZ20

…init_tokenizer.py code style ## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the...

liwenjuna

…mpts.py code style ## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the...

lanran2001

[BUG]: assert len(grad_args) > 0 in training the animate anyone

2

### 🐛 Describe the bug i'm using the colossalai to train the [animate anyone](https://github.com/guoqincode/Open-AnimateAnyone). but there is an error in unet forward. ```python Traceback (most recent call last): File "core/train_stage2_colo.py",...

zhangvia

[moe] support mixtral

1

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

oahzxl

… code style ## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the...

ofey404

[BUG]: bug in using HybridAdam optimizer

4

### 🐛 Describe the bug i'm using the colossalai to train animate anyone here is the code where bug happened: ```python for name, param in unet.named_parameters(): if "motion_modules" in name:...

zhangvia

flybird11111

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

imgaojun

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [x] The title follows the standard format: `[doc/gemini/tensor/...]: A...

TongLi3701