Vincent Wang

> Do you know which model has this pattern? MoE

The actual impl is not real fused one because MIOpen doesn't have related cudnnConvolutionBiasActivationForward. So I am thinking we just don't enable the ConvActivationFusion on ROCm so we don't need...

> > The actual impl is not real fused one because MIOpen doesn't have related cudnnConvolutionBiasActivationForward. So I am thinking we just don't enable the ConvActivationFusion on ROCm so we...

https://github.com/microsoft/onnxruntime/pull/17117 is trying to fix this.