Xinran / Allan Rui

[WIP] Add dtype attribute to TritonCSEVariable

37

Summary: - This diff introduces `dtype` attribute to `TritonCSEVariable` and a dtype propagation helper function to infer dtype from input to output for each op. - There will be a...

[Inductor/Triton] Upcast FP16/BF16 math reductions to FP32

6

Summary: Triton compiler does not automatically promote fp16/bf16 reductions to fp32 accumulation. This will result in significant accuracy issue. This diff will upcast the input to FP32 for all math...