ColossalAI

ColossalAI copied to clipboard

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

isky-cd

### Is there an existing issue for this bug? - [x] I have searched the existing issues ### 🐛 Describe the bug Installing Pytorch 2.3, which is required by the...

Edenzzzz

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [x] The title follows the standard format: `[doc/gemini/tensor/...]: A...

duanjunwen

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

Edenzzzz

### Is there an existing issue for this bug? - [X] I have searched the existing issues ### 🐛 Describe the bug This CI is not working and we should...

BoxiangW

### Describe the feature This issue contains requirements for the zerobubble pp. Source Github Link: https://github.com/sail-sg/zero-bubble-pipeline-parallelism Source Paper: https://arxiv.org/abs/2401.10241

duanjunwen

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

flybird11111

[BUG]: errror Colossalai 0.4.0/0.4.2 /usr/bin/supervisord

3

### Is there an existing issue for this bug? - [X] I have searched the existing issues ### 🐛 Describe the bug 当我启动训练的时候出现了下面的错误，怎么办？Ubuntu 22.04 ``` llama) root@autodl-container-ad594b8360-ad0d4c6e:~/autodl-tmp/ColossalAI/applications/ColossalChat/examples/training_scripts# bash train_sft.sh GPU...

Storm0921

[colossalai/checkpoint_io/...] fix bug in load_state_dict_into_model; format error msg

3

## 📌 Checklist before creating the PR - [x] I have created an issue for this PR for traceability - [x] The title follows the standard format: `[doc/gemini/tensor/...]: A concise...

flymin

[BUG]: AttributeError: 'GeminiDDP' object has no attribute 'module'

1

### Is there an existing issue for this bug? - [X] I have searched the existing issues ### 🐛 Describe the bug I'm trying to run Colossal AI's example on...

dheerj188