transformers.js icon indicating copy to clipboard operation
transformers.js copied to clipboard

openvino backend

Open RGdevz opened this issue 1 year ago • 3 comments

Feature request

is it possible to add openvino as backend?

Motivation

it is faster then onnxruntime

Your contribution

RGdevz avatar Aug 29 '24 21:08 RGdevz

Do you mean Intel's OpenVINO? Unfortunately there is no web support there.

gyagp avatar Aug 30 '24 03:08 gyagp

Do you mean Intel's OpenVINO? Unfortunately there is no web support there.

Yes, I meant for non web inference like in node js

RGdevz avatar Aug 30 '24 09:08 RGdevz

I think the current onnxruntime-node only supports CPU, DirectML and CUDA (https://onnxruntime.ai/docs/get-started/with-javascript/node.html).

gyagp avatar Aug 31 '24 05:08 gyagp