fast-stable-diffusion icon indicating copy to clipboard operation
fast-stable-diffusion copied to clipboard
verified publisher icon TheLastBen

this function is for sm80, but was built for sm700

Open Balerion300 opened this issue 3 years ago • 5 comments

Have been assigned an A100 (40GB) for the first time and the AUTOMATIC111 version of the UI seems to break for some reason, throwing this fatal error in a non-stop loop when trying to use txt2img or img2img:

FATAL: this function is for sm80, but was built for sm700

Balerion300 avatar Oct 04 '22 09:10 Balerion300

Are you using the notebook with the latest commit ?

TheLastBen avatar Oct 04 '22 09:10 TheLastBen

Current AUTOMATIC111 notebook with the latest commit, shows the following on execution: FATAL: this function is for sm75, but was built for sm600 Setting GPU class:Premium and the Runtime Shape:High Ram seems to solve the issue though.

Chajac avatar Oct 04 '22 23:10 Chajac

The xformers precompiled files seems incompatible with the A100, until a user provides me with the files, this error will persist for the A100

TheLastBen avatar Oct 04 '22 23:10 TheLastBen

I can try and get the files if I'm assigned an A100 again. How would I do that?

Balerion300 avatar Oct 05 '22 06:10 Balerion300

run :

!pip install git+https://github.com/facebookresearch/xformers@51dd119#egg=xformers

after around 50min, and the installation is done, navigate to /usr/local/lib/python3.7/dist-packages/xformers

save the two files : "_C_flashattention.so" and "_C.so", upload them to any host and send me the link and I will integrate them.

the files might not show in the colab explorer, so you will have to rename them

!cp /usr/local/lib/python3.7/dist-packages/xformers/_C.so /usr/local/lib/python3.7/dist-packages/xformers/C.py

!cp /usr/local/lib/python3.7/dist-packages/xformers/_C_flashattention.so /usr/local/lib/python3.7/dist-packages/xformers/C_flashattention.py

TheLastBen avatar Oct 05 '22 11:10 TheLastBen