ZCHNO issues

Repositories
Issues
Comments

Results 2 issues of


                                            ZCHNO

Question about FlashAttention and KV-cache

Hi, I notice that you use KV-cache with FlashAttention in CausalSelfAttention. As far as I am concerned, FlashAttention has already implemented the causal self-attention in its kernels, which means for...

[BUG] Can't find nccl when building from source

**Describe the bug** A clear and concise description of what the bug is. Can't find libnccl.so when building from source. It seems flux only builds static nccl lib instead of...