flybird11111

Results 68 comments of flybird11111

[BUG]: RuntimeError: value cannot be converted to type float without overflow

Thanks, I'll look into it.

[BUG]: RuntimeError: value cannot be converted to type float without overflow

Hi, I haven't been able to reproduce this issue. From the code, it seems that part_norm itself is of type float.

[BUG]: colossalai stucked with GPU1,2 while running with GPU0,1

Hi, can you identify where it is getting stuck? I'm unable to reproduce this issue.

[BUG]: how to disable FlashAttention

You can set enable_all_optimization to false. And configure other optimizations as needed.

[BUG]: Colossalai-OpenMoE example failed to converge

Thank you for your feedback; we will address this issue as soon as possible.

Gemini_auto error

Hi, could you please share the traceback? I'll look into this issue.

when I uese hybrid_parallel, and set the enable_fused_normalization = True. I can't run the code, here are some error: RuntimeError: Failed to replace input_layernorm of type LlamaRMSNorm with FusedRMSNorm with the exception: Please install apex from source (https://github.com/NVIDIA/apex) to use the fused RMS normalization kernel. Please check your model configuration or sharding policy, you can set up an issue for us to help you as well. However, I have install the apex, it will still occur. How can i solve it?

Hi, Please install apex from https://github.com/NVIDIA/apex, or set enable_fused_normlization to False.

when I uese hybrid_parallel, and set the enable_fused_normalization = True. I can't run the code, here are some error: RuntimeError: Failed to replace input_layernorm of type LlamaRMSNorm with FusedRMSNorm with the exception: Please install apex from source (https://github.com/NVIDIA/apex) to use the fused RMS normalization kernel. Please check your model configuration or sharding policy, you can set up an issue for us to help you as well. However, I have install the apex, it will still occur. How can i solve it?

Maybe the version of apex is not correct, can you have a try that "from apex.normalization import FusedRMSNorm"

when I uese hybrid_parallel, and set the enable_fused_normalization = True. I can't run the code, here are some error: RuntimeError: Failed to replace input_layernorm of type LlamaRMSNorm with FusedRMSNorm with the exception: Please install apex from source (https://github.com/NVIDIA/apex) to use the fused RMS normalization kernel. Please check your model configuration or sharding policy, you can set up an issue for us to help you as well. However, I have install the apex, it will still occur. How can i solve it?

> And I saw this prompt in `examples/language/llama2/scripts/benchmark_70B/3d.sh` > > ``` > # TODO: fix this > echo "3D parallel for LLaMA-2 is not ready yet" > ``` > >...

when I uese hybrid_parallel, and set the enable_fused_normalization = True. I can't run the code, here are some error: RuntimeError: Failed to replace input_layernorm of type LlamaRMSNorm with FusedRMSNorm with the exception: Please install apex from source (https://github.com/NVIDIA/apex) to use the fused RMS normalization kernel. Please check your model configuration or sharding policy, you can set up an issue for us to help you as well. However, I have install the apex, it will still occur. How can i solve it?

> > > And I saw this prompt in `examples/language/llama2/scripts/benchmark_70B/3d.sh` > > > ``` > > > # TODO: fix this > > > echo "3D parallel for LLaMA-2 is...