server icon indicating copy to clipboard operation
server copied to clipboard

Add `interceptors` parameter passing for `tritonclient.grpc(.aio).InferenceServerClient`

Open dmastapkovich opened this issue 1 year ago • 2 comments

Integration of OpenTelemetry with tritonclient can be made more convenient by passing the interceptors attribute to tritonclient.grpc(.aio).InferenceServerClient

class InferenceServerClient(InferenceServerClientBase):
    def __init__(
        self,
        url,
        ....,
        interceptors: Optional[Sequence[ClientInterceptor]] = None,
    ):
    ...
    self._channel = grpc.secure_channel(url, ...,  interceptors=interceptors)

dmastapkovich avatar Feb 07 '24 13:02 dmastapkovich

CC @oandreeva-nv for vis.

krishung5 avatar Feb 10 '24 01:02 krishung5

[DLIS-6161]

oandreeva-nv avatar Feb 13 '24 02:02 oandreeva-nv