StableCascade v100 cannot calculate bf16

v100 cannot calculate bf16

Open ganganngannn opened this issue 1 year ago • 2 comments

Hello, how do I modify the configuration if I want to use it on 32G v100?

Feb 22 '24 02:02 ganganngannn

Do you mean run.py line 39 error? I checked how automatic1111 .devices.py is structured and I tried:

device = "cuda" dtype = torch.float16 . . . with torch.cuda.amp.autocast(dtype=torch.float16):

and with 32, but results are bad.

Mar 01 '24 08:03 divergentti

we added fp16 support fully working : https://github.com/Stability-AI/StableCascade/issues/125

Mar 22 '24 03:03 FurkanGozukara