lightning-thunder icon indicating copy to clipboard operation
lightning-thunder copied to clipboard

Published 20 hours ago • verified publisher icon Lightning-AI

Makes cudnn a default executor

Open vedaanta opened this issue 9 months ago • 4 comments

Before submitting
  • [x] Was this discussed/approved via a Github issue? (no need for typos and docs improvements)
  • [x] Did you read the contributor guideline, Pull Request section?
  • [x] Did you make sure to update the docs?
  • [x] Did you write any new necessary tests?

What does this PR do?

Cudnn is now a default executor. The only operation targeted is sdpa.

The main change is a stricter checker function. Both forward and backward graph support are ensured before claiming sdpa operation. (The checker was previously made lenient in #57)

Fixes #418.

PR review

Anyone in the community is free to review the PR once the tests have passed. If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

vedaanta avatar May 16 '24 18:05 vedaanta