tritony
tritony copied to clipboard
[Support] OpenVINO Model Server
https://docs.openvino.ai/2024/ovms_docs_python_support_reference.html
kserve: https://github.com/kserve/kserve/blob/master/docs/predict-api/v2/grpc_predict_v2.proto triton_inference_server: https://github.com/triton-inference-server/common/blob/main/protobuf/grpc_service.proto