AMDMIGraphX icon indicating copy to clipboard operation
AMDMIGraphX copied to clipboard

Add Parser for Attention Contrib OP

Open TedThemistokleous opened this issue 11 months ago • 0 comments

Need support for the Onnxruntime Attention Contrib op https://github.com/microsoft/onnxruntime/blob/main/docs/ContribOperators.md#com.microsoft.Attention

Onnxruntime optimizations will fuse operators into Attention to speed up inference runs

This consists of the following changes.

  • [ ] Add Attention parser for the contrib operator
  • [ ] Add tests for varying inputs and parameters
  • [ ] Update MIGraphx EP support list in Onnxruntime (migraphx_execution_provider.cc)

We can leverage the existing torch-migraphx converts work via: https://github.com/ROCm/torch_migraphx/blob/de30914d9ddc8e27ca71d93c45688e2f9ca38912/py/torch_migraphx/fx/converters/acc_ops_converters.py#L2534

TedThemistokleous avatar Jan 31 '25 18:01 TedThemistokleous