core icon indicating copy to clipboard operation
core copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

Add the ability for backends to add entries to the trace

Open Tabrizian opened this issue 2 years ago • 2 comments

The API is tested by being used in the frontends.

Tabrizian avatar Feb 27 '23 17:02 Tabrizian

What's the state of this PR @Tabrizian ? Do we intend to finalize it at some point? I think a new backend API like this could enable a cleaner way to report nested spans (create traces) for OpenTelemetry tracing closer to the site, rather than the current behavior of reporting everything all at the end in the TRITONBACKEND_ReportStatistics callback. CC @oandreeva-nv

rmccorm4 avatar Jul 26 '23 19:07 rmccorm4

@rmccorm4 Sorry for the delay. This must have fallen through the cracks. Yeah, I think we probably want to have this API at some point for creating custom traces. Right now I think this is just blocked on testing. Part of it is now included in Olga's Otel PR.

Tabrizian avatar Aug 02 '23 17:08 Tabrizian