Billy Cao

The error is purely because you used xformers build for another version of cuda. If you rebuild xformers yourself with cuda11.7, it will work fine. I am using it for...

> Use half precision, it boost your performance around 50% For a 4090, it is the exact same, UNTIL pytorch implements Hopper's Transformer Engine. See https://www.techpowerup.com/gpu-specs/geforce-rtx-4090.c3889 (FP16 and FP32 are...

> https://github.com/ninele7/xfromers_builds/pull/1#issuecomment-1363609348 I have been using xformers on cuda 11.8 since this repo existed, with cu117 torch packages. No issues so far.

Yes i am building myself, but only for 0.14.0 as I am facing some errors when building 0.15.0 and newer. Currently using the official 0.16 wheels build on 11.7. The...

I dont feel its slow. I am on 3080ti.

My current setup IS your branch lol. I do ML myself so I already have torch+cu117 installed before this repo even existed. I use torch 1.13.1+cu117 though.

> So you have no issues using xformers 0.14 and 0.16 (pre-release) on cu 117? Yes. > it does build xformers 0.15 by default. All you have to do is...

The commit i cannot remember already as it was the latest commit when i built. I didn't have to checkout to a older commit for 0.14.0 at the time.

> Only thing I can see on your fork is that you deleted the .github directory, what was the workflow that produced xformers-0.0.14.dev0-cp310-cp310-win_amd64.whl? Deleting the .github does nothing. The build...

There is a reason because newer cuda versions bring performance improvements and bug fixes, as well as support for RTX 4000, and allows for xformers to be updated too, since...