flux icon indicating copy to clipboard operation
flux copied to clipboard

[ENHANCEMENT] 你好,fp8有计划支持吗

Open zkyue opened this issue 1 year ago • 3 comments

zkyue avatar Nov 13 '24 07:11 zkyue

@zkyue Yes, fp8 support is on the way. And we will release it in future.

wenlei-bao avatar Nov 13 '24 18:11 wenlei-bao

@zkyue Yes, fp8 support is on the way. And we will release it in future.

Thank you for your reply. I am now looking to apply Flux in my project to perform FP8 GEMM on the H100. What work still needs to be done with Flux at the moment? Is it just a matter of adding a data type like supporting FP16, or are there some underlying tasks that need to be addressed? How is the progress of your project, and when can we expect the next version to be released?

zkyue avatar Nov 14 '24 02:11 zkyue

@zkyue Yes, fp8 support is on the way. And we will release it in future.

Thank you for your reply. I am now looking to apply Flux in my project to perform FP8 GEMM on the H100. What work still needs to be done with Flux at the moment? Is it just a matter of adding a data type like supporting FP16, or are there some underlying tasks that need to be addressed? How is the progress of your project, and when can we expect the next version to be released?

FP8 is supported. checkout the lastest main or download the latest wheel and have a try.

houqi avatar Mar 12 '25 07:03 houqi