Yudong Pan

icon company University of Chinese Academy of Sciences icon location Beijing icon location ict ai system

Results 4 comments of Yudong Pan

Compatibility issue with CUDA 12.2

Have you resolved this error? I found this similar error when I tried to “make -j12”.

Compatibility issue with CUDA 12.2

I tried this but the problem is not be solved. but thank you!

Compatibility issue with CUDA 12.2

> I am facing the same issue. Has anyone found the fix yet? I finally solved the problem and realized it was that when I was compiling, it should have...

[Bug]: `size_k must divisible by BLOCK_SIZE_K` error when using tensor parallelism with AWQ-quantized MoE models

I have the same issue with [OPEA/DeepSeek-V2.5-1210-int4-sym-inc](https://huggingface.co/OPEA/DeepSeek-V2.5-1210-int4-sym-inc) using TP=8，TP=4 is OK.