MLServer
MLServer copied to clipboard
Support custom gRPC endpoints
trafficstars
We currently allow users to define custom endpoints on their inference runtimes. However, these endpoints are only served through REST.
This issue should explore mechanisms to also allow users to define custom gRPC services (with custom payloads).