ColossalAI

ColossalAI copied to clipboard

支持qwen吗

3

Storm0921

### Is there an existing issue for this bug? - [X] I have searched the existing issues ### 🐛 Describe the bug loading sharded model does not raise an error...

flymin

…cessary copies of the data ## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title...

monster29000

wangbluo

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

Hz188

### Is there an existing issue for this bug? - [X] I have searched the existing issues ### 🐛 Describe the bug Posting this for documentation purposes. torch.compile has been...

Edenzzzz

### Describe the feature I build a custom network with some custom operators, e.g., flash-attention. But I found neither colotracer nor node_handler can deal with them successfully. But I don't...

robotsp

[benchmark]: llama add tokens metrics

1

When benchmarking a LLM, token/s is also an important metric, so this metric is added to the llama benchmark.

zeroorhero

[BUG]: Low_Level_Zero plugin crashes with LoRA

14

### Is there an existing issue for this bug? - [X] I have searched the existing issues ### 🐛 Describe the bug The line **808** of `zero/low_level/low_level_optim.py` assumes that every...

Fallqs

wangbluo