sherpa-onnx icon indicating copy to clipboard operation
sherpa-onnx copied to clipboard

Published 20 hours ago • verified publisher icon k2-fsa

[draft] Support OpenVINO as Execution Provider

Open frankyoujian opened this issue 1 year ago • 0 comments
trafficstars

These are hack codes for anyone who wants to try OpenVINO as Execution Provider

Prerequisites: Follow this wiki to setup OpenVINO toolkit and build ONNX Runtime

After building ONNX Runtime from source, copy the generated dlls/libs and include folder to sherpa-onnx's build\_deps\onnxruntime-src

Conclusion: OpenVINO EP performs a little bit worse than CPU EP:

  • OpenVINO EP RTF(0.094)

k2_openvino

  • CPU EP RTF(0.08)

k2_cpu

frankyoujian avatar Jan 24 '24 08:01 frankyoujian