model_server
model_server copied to clipboard
I hope the official will add sample code for grpc's java, Android, and web clients. The server deployment is very easy, but the grpc client is not easy.
I hope the official will add sample code for grpc's java, Android, and web clients. The server deployment is very easy, but the grpc client is not easy.
Thank you very much
@yg-dickson did you try the triton client? It is compatible with ovms via KServer API. https://github.com/openvinotoolkit/model_server/tree/main/client/java/kserve-api