braxtynmd comments

Repositories
Issues
Comments

Results 1 comments of


                                            braxtynmd

[Bug]: `size_k must divisible by BLOCK_SIZE_K` error when using tensor parallelism with AWQ-quantized MoE models

Also tested with [Qwen/Qwen3-235B-A22B-GPTQ-Int4](https://huggingface.co/Qwen/Qwen3-235B-A22B-GPTQ-Int4) and experienced the same issue. TP=8, with 8x A6000