[Bug]: FP8 breaks some LORAs

[banjaminicc]

Checklist

• [ ] The issue exists after disabling all extensions
• [X] The issue exists on a clean installation of webui
• [ ] The issue is caused by an extension, but I believe it is caused by a bug in the webui
• [ ] The issue exists in the current version of the webui
• [ ] The issue has not been reported before recently
• [ ] The issue has been reported before but has not been fixed yet

What happened?

Networks with errors: ahxl_v1 (32) Tested multiple SDXL models and all are broken Only breaks certain LORAs Tested both fp8 and fp16 LORAs

Steps to reproduce the problem

1.Enable FP8 for SDXL in settings and load LORA 2. Perform inference as usual 3. Some LORAs will show errors without more detail

What should have happened?

1. Better and clearer error measure or
2. Improve FP8 supports for LORAs

What browsers do you use to access the UI ?

Mozilla Firefox

Sysinfo

sysinfo-2024-01-27-16-44.json

Console logs

N.A

Additional information

No response