Iman Tabrizian

Results 132 comments of Iman Tabrizian

> This then goes on forever, until my init healthcheck fails after which the process is started anew. If the health check fails, it likely means that the stub process...

Hi @LucQueen, can you clarify which test you are running? You can read more about the PyTorch naming conventions here: https://github.com/triton-inference-server/server/blob/main/docs/model_configuration.md#special-conventions-for-pytorch-backend

@ShamariYoti Does the signature def that you are specifying exist in the model? Looks like if Triton is not able to find the correct SIGDEF it choses one randomly. I...

@ShamariYoti Can you share your model so that we can look into this issue?

Thanks for your feature request. There is a ticket on our backlog for the same but it has not been priotorized yet.

@Jackiexiao Thanks for your feature request. Perf Analyzer has limited support for decoupled mode by measuring the time between the request and first response. However, as you mentioned in the...

Sorry for the delayed response. This is on our roadmap but it has not been scheduled yet. We'll let you know as soon as there is an updated.

@wesselvdv @AJHoeh @kthui has fixed a number of issues related to Python backend hangs [here ](https://github.com/triton-inference-server/python_backend/commit/32974481c4875ad22bf318dcb2b80e316cdf5065)and [here](https://github.com/triton-inference-server/python_backend/commit/00468e5f9d4d61c4b2fabf941b87424291e81e36). They will be included in 23.02 release. If they still didn't resolve the...

Sorry, we haven't be able to still get to this issue. Will update you as soon as there are any updates.

@randomguy2022 @kthui has fixed a number of issues related to Python backend hangs [here ](https://github.com/triton-inference-server/python_backend/commit/32974481c4875ad22bf318dcb2b80e316cdf5065)and [here](https://github.com/triton-inference-server/python_backend/commit/00468e5f9d4d61c4b2fabf941b87424291e81e36). They will be included in 23.02 release. If they still didn't resolve the hang,...