mxnet icon indicating copy to clipboard operation
mxnet copied to clipboard

Can We implement Flash attention 2 in MXnet

Open rajveer43 opened this issue 2 years ago • 1 comments
trafficstars

Description

Flash Attention 2 is a library that provides attention operation kernels for faster and more memory efficient inference and training:

References

rajveer43 avatar Oct 05 '23 06:10 rajveer43

Welcome to Apache MXNet (incubating)! We are on a mission to democratize AI, and we are glad that you are contributing to it by opening this issue. Please make sure to include all the relevant context, and one of the @apache/mxnet-committers will be here shortly. If you are interested in contributing to our project, let us know! Also, be sure to check out our guide on contributing to MXNet and our development guides wiki.

github-actions[bot] avatar Oct 05 '23 06:10 github-actions[bot]