BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

Published 20 hours ago • verified publisher icon bentoml

bug: incorrect tracing when batching is enabled

Open ssheng opened this issue 1 year ago • 2 comments

When batching is enabled, runner’s /receive span and any subsequent spans created in the service are always attributed towards the first trace id. The the trace of the first request will indefinitely grow as new requests arrive.

ssheng avatar Sep 13 '22 09:09 ssheng

Is this addressed in https://github.com/bentoml/BentoML/pull/2977?

parano avatar Sep 14 '22 00:09 parano

No but https://github.com/bentoml/BentoML/pull/2996 is intended to address it.

ssheng avatar Sep 16 '22 08:09 ssheng