Eugene Brodsky
Results
132
comments of
Eugene Brodsky
The PyTorch blog says Flash Attention is supported from sm80 compute capability onwards: https://pytorch.org/blog/accelerated-pytorch-2/, so perhaps we should default to `xformers` for anything lower than that. (As @hipsterusername said, with...
We've recently updated ROCm images; closing this - please open another issue if still experiencing problems.