iree icon indicating copy to clipboard operation
iree copied to clipboard

[Attention] Generalize Attention Tiling and Decomposition

Open Groverkss opened this issue 1 year ago • 0 comments

Attention tiling and decomposition today are hardcoded. It assumes the rank and position of some dimensions. This makes it hard to do fusions with attention. This needs to be fixed by making the tiling and decomposition depend on the indexing maps for attention instead.

Groverkss avatar May 22 '24 11:05 Groverkss