cutlass icon indicating copy to clipboard operation
cutlass copied to clipboard

[QST]What does Epilogue do?(Especially in Hopper)

Open ziyuhuang123 opened this issue 6 months ago • 1 comments

I am writing example 48, and I noticed file: https://github.com/NVIDIA/cutlass/blob/06b21349bcf6ddf6a1686a47a137ad1446579db9/include/cutlass/gemm/kernel/sm90_gemm_tma_warpspecialized_cooperative.hpp#L321 I find out with surprise that, epilogue is in producer, but we do not even enter epilogue?! Previously I guess we save result using epilogue, both rearrange it into shared memory and then save into global, but now, storing is done in cousumer...?

ziyuhuang123 avatar Aug 02 '24 09:08 ziyuhuang123