server
server copied to clipboard
Add `interceptors` parameter passing for `tritonclient.grpc(.aio).InferenceServerClient`
Integration of OpenTelemetry with tritonclient
can be made more convenient by passing the interceptors
attribute to tritonclient.grpc(.aio).InferenceServerClient
class InferenceServerClient(InferenceServerClientBase):
def __init__(
self,
url,
....,
interceptors: Optional[Sequence[ClientInterceptor]] = None,
):
...
self._channel = grpc.secure_channel(url, ..., interceptors=interceptors)
CC @oandreeva-nv for vis.
[DLIS-6161]