Eugene Brodsky

Results 132 comments of Eugene Brodsky

The PyTorch blog says Flash Attention is supported from sm80 compute capability onwards: https://pytorch.org/blog/accelerated-pytorch-2/, so perhaps we should default to `xformers` for anything lower than that. (As @hipsterusername said, with...

We've recently updated ROCm images; closing this - please open another issue if still experiencing problems.