iree
iree copied to clipboard
[LLVMGPU] Account for scales when picking schedule
Context: https://github.com/iree-org/iree/pull/22737#discussion_r2577897836
During the schedule selection process there are various places where we still do not adequately support scaled intrinsics.
- The selection of the A.I cutoff points for gemms requires some tuning.
- Need to add support for data types to the AI calculations, so we do not overestimate the A.I of a given scaled matmul problem.
- There are various structs, like GPUMatmulShape, used in the heuristic selection process that do not account for scales at all. All of these must be updated as well.