LiuShixing

Results 4 comments of LiuShixing

[Bug] Int8 quantize inference failed using bloom-inference-scripts/bloom-ds-inference.py with deepspeed==0.9.0 on multi-gpus

Same error, how to solve it?

Does it support model parallel? How to convert ColumnParallelLinear to lora linear?

> Think you, I had implement it

bloomz-mt universal checkpoint

Thinks,  it seems that option 3 is best for me. 发自我的iPhone ------------------ Original ------------------ From: Niklas Muennighoff ***@***.***> Date: Fri,May 26,2023 7:20 AM To: bigscience-workshop/xmtf ***@***.***> Cc: LiuShixing ***@***.***>, Author...

适配arm机器安装python包失败

同样的问题，请问你解决了吗？