David Goodwin

There is also another LibEvent that needs to be changed to Libevent in CMakeLists.txt. Here: https://github.com/criticalstack/libevhtp/blob/1.2.18/CMakeLists.txt#L60

@piekey1994 Can you provide repro steps, models, etc. so that we can reproduce this step.

FYI @askhade

@askhade Can you comment on this issue.

@askhade I'm not familiar with what ONNX_TYPE_SEQUENCE is, but triton itself only supports tensors-in / tensors-out. It seems like one problem here is that the automatic configuration generator for onnxruntime...

It should be possible with changes to the server grpc implementation, but we haven't looked at it in detail.

It seems that your output tensor is class index values, not probabilities. Classification output assumes that the output tensor contains probabilities (specifically the probability for each class). Perhaps you can...

If there is an earlier point in your model where you have not yet sorted the items by confidence, and instead there is a tensor where each entry is a...

In recent triton versions there is a trace API that you can use to change the trace parameters: https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_trace.md

The HTTP query params are not available to a python model. Can you describe what per-inference-request information you want to pass into the python?