Yiran-Zhu

icon company UESTC icon location Beijing

Results 2 issues of Yiran-Zhu

[BUG]: No module named 'colossalai._C.cpu_adam'

33 comment

### 🐛 Describe the bug When I run the command `torchrun --standalone --nproc_per_node=2 train_prompts.py prompts.csv --strategy colossalai_gemini` in the `ColossalAI/applications/ChatGPT/examples` directory, an error occurs. `ModuleNotFoundError: No module named 'colossalai._C.cpu_adam'` ###...

bug

GLM-10B怎么使用模型并行

2 comment

请教一个关于模型并行的问题，`python change_mp.py path_to_the_checkpoint 2`命令中的path_to_the_checkpoint该怎么设置呢？ 是从huggingface下载的权重地址吗 `/home/xxx/.cache/huggingface/hub/models--BAAI--glm-10b/snapshots/abf4a89b8dff080609bc0db4720e47d784474a52/pytorch_model.bin`