tilelang icon indicating copy to clipboard operation
tilelang copied to clipboard

[Feature Request] Introduce `T.gemm_sp_v2` for 2:4 Sparse Tensor Core GEMM

Open botbw opened this issue 2 months ago • 0 comments

The gemm_sp (v1) has been supported on sm80, sm89, and sm90. It leverages the CUTLASS backend and requires the metadata to conform to specific CUTE layouts, which restricts flexibility and increases compilation time.

gemm_sp_v2 proposes to remove the dependency and allow full granularity of metadata layout directly in Tilelang, while still offering a compatible layout and corresponding compression utilities.

Related PRs: https://github.com/tile-ai/tilelang/pull/793, https://github.com/tile-ai/tilelang/pull/813

botbw avatar Oct 03 '25 10:10 botbw