can I trans model to onnx for online serving?

Open xealml opened this issue 2 years ago • 5 comments

Mar 14 '23 11:03 xealml

We don't have immediate plan for ONNX support. PR is welcomed.

Mar 14 '23 16:03 dxli94

looking forward to onnx converter for serving

Mar 16 '23 09:03 dongrixinyu

I've tried converting to ONNX or TorchScript [to land it on Triton/TensorRT], quite a few issues. Seems that other people had issues with the ONNX export too - https://github.com/microsoft/onnxruntime/issues/12594

Mar 23 '23 20:03 dchichkov

To add to the list of issues, https://github.com/pytorch/pytorch/issues/94280

Mar 31 '23 22:03 Infinitay

convert model to onnx for online serving，have it been sovled?

Apr 19 '23 12:04 joewale

when convert model (blip2_opt) to onnx ,I get onnx without any weight and it ‘s size show only 1kb.How can i fix it or anyone face this seem problem?

Aug 31 '23 08:08 Nagaloop