tutorials ONNXRuntime Server in windows

Hi, Can someone please help me How can I build and use the OnnxRuntime Server in windows which can support gRPC and HTTP.

I have made a c++ api which take a image as input and uses onnx model for Inference,Now I want to create the server for model inference. Any help would be appreciated. Thanks!!

Jul 07 '20 07:07 anirudha16101

@anirudha16101 : Please check the following documentation around this: Usage: https://github.com/microsoft/onnxruntime/blob/6d4f2f5bf92f86a8bbe52b6ecfed4bd1eb5e4ed1/docs/ONNX_Runtime_Server_Usage.md

Tutorial: https://github.com/onnx/tutorials/blob/master/tutorials/OnnxRuntimeServerSSDModel.ipynb

Jul 07 '20 18:07 askhade

@askhade Thank You , I saw the document but the sever is only available in Linux. Is there is any way that we can build it in windows. I am not sure is it available in windows or not ? Thanks for Help!!

Jul 08 '20 04:07 anirudha16101

Hi @anirudha16101,

The tutorial being referred to above is mostly to depict the usage of the ONNX Runtime server once you have the server running. The ONNX Runtime server runs only on Linux at this point and hence the server itself would have to run on a Linux machine. You can run the rest of the notebook on a Windows machine (change the appropriate endpoints).

Jul 23 '20 20:07 hariharans29