iree icon indicating copy to clipboard operation
iree copied to clipboard

[LLVMGPU] Account for scales when picking schedule

Open Muzammiluddin-Syed-ECE opened this issue 4 weeks ago • 0 comments

Context: https://github.com/iree-org/iree/pull/22737#discussion_r2577897836

During the schedule selection process there are various places where we still do not adequately support scaled intrinsics.

  • The selection of the A.I cutoff points for gemms requires some tuning.
  • Need to add support for data types to the AI calculations, so we do not overestimate the A.I of a given scaled matmul problem.
  • There are various structs, like GPUMatmulShape, used in the heuristic selection process that do not account for scales at all. All of these must be updated as well.

Muzammiluddin-Syed-ECE avatar Dec 01 '25 19:12 Muzammiluddin-Syed-ECE