ERROR lora diffusion_model.single_blocks.37.linear2.weight "addmm_cuda" not implemented for 'Float8_e4m3fn'

[AI-Made-Simple]

Expected Behavior

Get this error when running Lora - Not sure if its something Im doing wrong or does not seem to like Float8_e4m3fn or running FP8?

Lora - https://civitai.com/models/304097/commodore-64-style-pixel-art

Actual Behavior

ERROR lora diffusion_model.single_blocks.37.linear2.weight "addmm_cuda" not implemented for 'Float8_e4m3fn'

Steps to Reproduce

Run workflow https://openart.ai/workflows/-/-/fsDZFTboKAR33l0L7ifp

Debug Logs

loaded partially 9981.8 9981.720764160156 30
  0%|                                                                                           | 0/25 [00:00<?, ?it/s]ERROR lora diffusion_model.single_blocks.28.linear1.weight "addmm_cuda" not implemented for 'Float8_e4m3fn'
ERROR lora diffusion_model.single_blocks.28.linear2.weight "addmm_cuda" not implemented for 'Float8_e4m3fn'

Other

No response

[kenic123]

我也一样 me too

[Voinay]

I downgraded my torch to 2.3.1 and it never comes out. Hope it can work for you.

[LiJT]

I downgraded my torch to 2.3.1 and it never comes out. Hope it can work for you.

But "--fast" only support torch 2.4.0 and above....downgrading torch is not ideal. I also have the same problem

ERROR lora diffusion_model.double_blocks.0.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.0.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.1.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.1.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.10.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.10.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.11.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.11.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.12.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.12.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.13.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.13.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.14.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.14.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.15.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.15.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.16.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.0.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.0.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn'