s-tlgh issues

Repositories
Issues
Comments

Results 1 issues of


                                            s-tlgh

[Enhancement Request] SDFA does not support head dimension of size 192 (capped at 128)

**Describe the bug** SDFA currently does not support head dimension outside of 64, 96, and 128. **To Reproduce** Fused attention falls back to regular operation when head dimension is not...

enhancement