LucisVivae comments

Repositories
Issues
Comments

Results 2 comments of


                                            LucisVivae

CUDA based Pytorch Flash Attention is straight up non-functional / non-existent on Windows in ALL PyTorch versions above 2.1.2, opening this issue just to remove the weird vagueness around this.

might have something to do with flash attention 2 not yet officially supporting windows. it can be compiled though for instance see [https://www.charlesherring.com/coding/compiling-pytorch-windows11](https://www.charlesherring.com/coding/compiling-pytorch-windows11)

GPU not detected

have got past the above by reinstalling torch which for some reason did not initially install cuda support. but now it is telling me "You have loaded an AWQ model...

LucisVivae

CUDA based Pytorch Flash Attention is straight up non-functional / non-existent on Windows in *ALL* PyTorch versions above 2.1.2, opening this issue just to remove the weird vagueness around this.

GPU not detected

CUDA based Pytorch Flash Attention is straight up non-functional / non-existent on Windows in ALL PyTorch versions above 2.1.2, opening this issue just to remove the weird vagueness around this.