tilelang icon indicating copy to clipboard operation
tilelang copied to clipboard

[Question] Is flash attention supported in sm100 with head dimension 256?

Open CanyonWind opened this issue 2 months ago • 0 comments

Required prerequisites

Questions

Hi, I plan to run our model on B200 (don't have it yet) and would like to confirm whether tile-lang Flash Attention can handle head dim 256 on sm100 before we get access to the B200 nodes. A quick confirmation would save us a lot trouble/cost. Much appreciate

CanyonWind avatar Nov 11 '25 06:11 CanyonWind