Charlene Yang
Charlene Yang
@timmoon10 thanks for the table :smiley_cat: I was doing something like that myself (OCD? not if someone else is also doing it!). After looking through some of the other frameworks'...
Hi @sirutBuasai , could you try upgrading to cuDNN 8.9.7+ please?
I think it's probably v0.10, but I'd rather you roll forward with cuDNN than backward with TE. There's been a lot of development in the last year or so. If...
> This PR changes the fused attention API. I'm wondering if we can also change `cu_seqlens` arguments to `actual_seqlens`, so that we can avoid the kernel to convert `actual_seqlens` to...