composable_kernel icon indicating copy to clipboard operation
composable_kernel copied to clipboard
verified publisher icon ROCmSoftwarePlatform

Refactor f8_t and bf8_t as custom types, enable use of custom types

Open geyyer opened this issue 1 year ago • 2 comments

  • Refactor f8_t and bf8_t
  • Update conversion methods
  • Update load method
  • Add dynamic buffer custom types support
  • Update threadwise conversion

Right now custom types are supported as source types, their support as destination types is coming soon...

geyyer avatar Feb 14 '24 19:02 geyyer

Could you do a performance check to make sure the new custom data type has no impact on the performance of fp8_gemm?

zjing14 avatar Feb 14 '24 21:02 zjing14

@zjing14 There is no perf drop on example_gemm_xdl_fp8, nice!

geyyer avatar Feb 22 '24 17:02 geyyer

Current work is covered in https://github.com/ROCm/composable_kernel/pull/1333

geyyer avatar Jun 26 '24 19:06 geyyer