cutlass icon indicating copy to clipboard operation
cutlass copied to clipboard

Add Ampere GEMM example using Cute and CUTLASS 3.x

Open aacostadiaz opened this issue 1 year ago • 6 comments

This pull request adds a GEMM example for the NVIDIA Ampere architecture, using Cute and CUTLASS 3.x. This example demonstrates how to create a GEMM kernel using the Cute components defined for SM80 and the Collective MMA and Collective Epilogue APIs provided in CUTLASS 3.x.

aacostadiaz avatar Jun 27 '24 16:06 aacostadiaz

@thakkarV @ccecka

hwu36 avatar Jul 10 '24 16:07 hwu36

this looks like a copy paste of the version we already have in the test dir. may I ask why you want to have this in the examples dir? we already have example 59 which does this

thakkarV avatar Jul 10 '24 17:07 thakkarV

this looks like a copy paste of the version we already have in the test dir. may I ask why you want to have this in the examples dir? we already have example 59 which does this

Hi @thakkarV,

Thank you for your feedback.

This example is meant to complement the version in the test directory and provide more visibility for users who may not explore that directory.

It serves as an entry-level example, similar to example 14 for Ampere with Cutlass 2.x and examples 48 and 49 for Hopper on Cutlass 3.x. In addition, it allows users to easily experiment with different GEMM configurations, enabling them to tune GEMM to their needs. I could not find an easy way to do that without implementing this example.

Example 59 is much more complicated than what I'm adding here. I don't think it targets the same users or use case.

I think it is a valuable contribution that we have found useful for us and could be for others.

aacostadiaz avatar Jul 11 '24 10:07 aacostadiaz

@aacostadiaz do you no longer want this merged?

thakkarV avatar Jul 15 '24 14:07 thakkarV

Hi @thakkarV, yes. I still would like this to get merged. I accidentally closed it, sorry.

aacostadiaz avatar Jul 15 '24 17:07 aacostadiaz

This PR has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this PR if it is no longer required. Otherwise, please respond with a comment indicating any updates. This PR will be labeled inactive-90d if there is no activity in the next 60 days.

github-actions[bot] avatar Aug 14 '24 17:08 github-actions[bot]

This PR has been labeled inactive-90d due to no recent activity in the past 90 days. Please close this PR if it is no longer required. Otherwise, please respond with a comment indicating any updates.

github-actions[bot] avatar Nov 12 '24 17:11 github-actions[bot]