BladeDISC icon indicating copy to clipboard operation
BladeDISC copied to clipboard

Kernel Fusion of BladeDISC

Open LiZerun opened this issue 2 years ago • 3 comments

I would like to ask if there is a way to get the kernel fusion results of bladeDISC(such as bert)? I tried the Nsight System but the kernel name is not very intutitive, it is difficult to deduce what operations the kernel includes. I also tried the "TORCH_BLADE_DEBUG_LOG" option of DISC, but the obtained IR does not seem to be able to see the kernel-level information.

LiZerun avatar Oct 21 '22 13:10 LiZerun

See the IR dump after DiscFusionPass.

wyzero avatar Oct 24 '22 08:10 wyzero

Thank you very much for your help. Is there any relation between the IRs of dump.[date].mlir and mhlo_compile.[date].log. Does the previous file contain the final IR of the forward function?

LiZerun avatar Oct 25 '22 09:10 LiZerun

dump.[date].mlir is mhlo IR converted from input torch model, which will be fed to BladeDISC compiler. mhlo_conpile.[date].log is the output of BladeDISC compiler, it contains detailed output IR if every stage.

qiuxiafei avatar Oct 27 '22 06:10 qiuxiafei

Thanks

LiZerun avatar Nov 02 '22 04:11 LiZerun