Derry Lin issues

Repositories
Issues
Comments

Results 1 issues of


                                            Derry Lin

Question about FP8 Tensor Core Mantissa Precision

Thank you for your insightful work on understanding the precision limitations of FP8 Tensor Core operations. I have a question regarding the mantissa precision in the accumulation process described in...