AMDMIGraphX
AMDMIGraphX copied to clipboard
Add Parser for Attention Contrib OP
Need support for the Onnxruntime Attention Contrib op https://github.com/microsoft/onnxruntime/blob/main/docs/ContribOperators.md#com.microsoft.Attention
Onnxruntime optimizations will fuse operators into Attention to speed up inference runs
This consists of the following changes.
- [ ] Add Attention parser for the contrib operator
- [ ] Add tests for varying inputs and parameters
- [ ] Update MIGraphx EP support list in Onnxruntime (migraphx_execution_provider.cc)
We can leverage the existing torch-migraphx converts work via: https://github.com/ROCm/torch_migraphx/blob/de30914d9ddc8e27ca71d93c45688e2f9ca38912/py/torch_migraphx/fx/converters/acc_ops_converters.py#L2534