fp8 is not supported

[emptybamboo]

The image generated in f8 mode will report an error Error occurred when executing T5TextEncode #ELLA:

"index_select_cuda" not implemented for 'Float8_e5m2'

[JettHu]

The f8 mode is not supported yet. I will take a look at this issue this week.

[CyberTimon]

I also run into the same issue. I really hope this get's fixed soon as fp8 enables much less vram usage.

[emptybamboo]

I really doubt that the ella node has been abandoned by Tencent, because it is also produced by Tencent, and the node of t-gate is updated very frequently, almost every day, but the ella node is rarely updated.😭

[LuLmaster69]

I am too hoping for fp8 support.

[CyberTimon]

Does anyone know how this got implemented in other repos? Maybe we can look at their code and do it ourselve.

[JettHu]

In fact, this is mainly a problem with T5. If anyone can provide me with a way to run T5 in FP8 mode, I would be very grateful.

And because the basic features of ELLA have been stabilized, we are doing some other work about EMMA recently.