onnxruntime icon indicating copy to clipboard operation
onnxruntime copied to clipboard

[VitisAI] Translate all session configs into provider options with prefix

Open chenduan-amd opened this issue 1 year ago • 1 comments

Description

We need to translate all session configs into provider options, prefix with ort_session_config, so that we can pass ORT session options to VAIP

Motivation and Context

Based on this PR(https://github.com/microsoft/onnxruntime/pull/21781), we need to provide a comprehensive interface to handle both session_configs and provider_options together. To achieve this, we use prefixes on the onnxruntime side to differentiate between the two.

chenduan-amd avatar Aug 29 '24 03:08 chenduan-amd

@microsoft-github-policy-service agree company="Advanced Micro Devices, Inc."

chenduan-amd avatar Aug 29 '24 03:08 chenduan-amd

/azp run Windows ARM64 QNN CI Pipeline,Windows x64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CUDA CI Pipeline,Windows GPU DML CI Pipeline,Windows GPU Doc Gen CI Pipeline,Windows GPU TensorRT CI Pipeline,ONNX Runtime Web CI Pipeline,Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline

tianleiwu avatar Sep 03 '24 20:09 tianleiwu

/azp run Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,orttraining-amd-gpu-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,onnxruntime-binary-size-checks-ci-pipeline

tianleiwu avatar Sep 03 '24 20:09 tianleiwu

/azp run Big Models,Linux Android Emulator QNN CI Pipeline,Android CI Pipeline,iOS CI Pipeline,ONNX Runtime React Native CI Pipeline

tianleiwu avatar Sep 03 '24 20:09 tianleiwu

Azure Pipelines successfully started running 5 pipeline(s).

azure-pipelines[bot] avatar Sep 03 '24 20:09 azure-pipelines[bot]

Azure Pipelines successfully started running 10 pipeline(s).

azure-pipelines[bot] avatar Sep 03 '24 20:09 azure-pipelines[bot]

Azure Pipelines successfully started running 10 pipeline(s).

azure-pipelines[bot] avatar Sep 03 '24 20:09 azure-pipelines[bot]

/azp run Windows ARM64 QNN CI Pipeline,Windows x64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CUDA CI Pipeline,Windows GPU DML CI Pipeline,Windows GPU Doc Gen CI Pipeline,Windows GPU TensorRT CI Pipeline,ONNX Runtime Web CI Pipeline,Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline

jywu-msft avatar Sep 04 '24 15:09 jywu-msft

/azp run Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,orttraining-amd-gpu-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,onnxruntime-binary-size-checks-ci-pipeline

jywu-msft avatar Sep 04 '24 15:09 jywu-msft

/azp run Big Models,Linux Android Emulator QNN CI Pipeline,Android CI Pipeline,iOS CI Pipeline,ONNX Runtime React Native CI Pipeline

jywu-msft avatar Sep 04 '24 15:09 jywu-msft

Azure Pipelines successfully started running 10 pipeline(s).

azure-pipelines[bot] avatar Sep 04 '24 15:09 azure-pipelines[bot]

Azure Pipelines successfully started running 5 pipeline(s).

azure-pipelines[bot] avatar Sep 04 '24 15:09 azure-pipelines[bot]

Azure Pipelines successfully started running 10 pipeline(s).

azure-pipelines[bot] avatar Sep 04 '24 15:09 azure-pipelines[bot]

https://github.com/microsoft/onnxruntime/actions/runs/10698900556/job/29678983177?pr=21907 can you address clang-format lint error? also please merge latest main branch

jywu-msft avatar Sep 04 '24 18:09 jywu-msft

/azp run Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,orttraining-amd-gpu-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,onnxruntime-binary-size-checks-ci-pipeline

jywu-msft avatar Sep 09 '24 15:09 jywu-msft

Azure Pipelines successfully started running 10 pipeline(s).

azure-pipelines[bot] avatar Sep 09 '24 15:09 azure-pipelines[bot]

@chenduan-amd, Please fix python format using lintrunner:

pip install -r requirements-lintrunner.txt
pip install intrunner
lintrunner init
lintrunner -a

tianleiwu avatar Sep 09 '24 15:09 tianleiwu

@chenduan-amd, Please fix python format using lintrunner:

pip install -r requirements-lintrunner.txt
pip install intrunner
lintrunner init
lintrunner -a
      2837 |-  for(const auto &option: options->value.config_options.configurations) {
      2838 |+  for (const auto& option : options->value.config_options.configurations) {

jywu-msft avatar Sep 09 '24 16:09 jywu-msft

/azp run Linux OpenVINO CI Pipeline

jywu-msft avatar Sep 09 '24 16:09 jywu-msft

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Sep 09 '24 16:09 azure-pipelines[bot]

/azp run Linux OpenVINO CI Pipeline

jywu-msft avatar Sep 10 '24 04:09 jywu-msft

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Sep 10 '24 04:09 azure-pipelines[bot]

/azp run Windows ARM64 QNN CI Pipeline,Windows x64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CUDA CI Pipeline,Windows GPU DML CI Pipeline,Windows GPU Doc Gen CI Pipeline,Windows GPU TensorRT CI Pipeline,ONNX Runtime Web CI Pipeline,Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline

tianleiwu avatar Sep 10 '24 05:09 tianleiwu

/azp run Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,orttraining-amd-gpu-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,onnxruntime-binary-size-checks-ci-pipeline

tianleiwu avatar Sep 10 '24 05:09 tianleiwu

/azp run Big Models,Linux Android Emulator QNN CI Pipeline,Android CI Pipeline,iOS CI Pipeline,ONNX Runtime React Native CI Pipeline

tianleiwu avatar Sep 10 '24 05:09 tianleiwu

Azure Pipelines successfully started running 10 pipeline(s).

azure-pipelines[bot] avatar Sep 10 '24 05:09 azure-pipelines[bot]

Azure Pipelines successfully started running 5 pipeline(s).

azure-pipelines[bot] avatar Sep 10 '24 05:09 azure-pipelines[bot]

Azure Pipelines successfully started running 9 pipeline(s).

azure-pipelines[bot] avatar Sep 10 '24 05:09 azure-pipelines[bot]

https://github.com/microsoft/onnxruntime/pull/22096 replaces this PR, correct?

jywu-msft avatar Oct 07 '24 04:10 jywu-msft