Ryan McCormick

Results 159 comments of Ryan McCormick

Hi @Vinayaks117 , For #3 I see validation failed and you get the same all `nan` outputs, which likely means there's an issue with your model, and this is not...

Hi @nrakltx , As of today, I suspect you might find better performance from the single model as opposed to the ensemble model due to some of the communication overhead...

Hi @taneem-ibrahim, Thanks for pointing this out. We recently had a doc restructure on the server repo and will need to update links in other repos accordingly.

Hi @wangchengdng , In your first example where, did you try explicitly setting `batch_size: 0` for the cuda graph as described [here](https://github.com/triton-inference-server/common/blob/main/protobuf/model_config.proto#L770-L776)? Zero might be the default when excluded, but...

Hi @roachsinai , Can you try the following for more info? 1. See if this issue still happens in the latest 22.07-py3 image 2. Run the following commands inside the...

Was this just to run CI for https://github.com/triton-inference-server/python_backend/pull/184? If so, a PR isn't required, the branch just has to exist.

Hi @wooAo , > model_repository_manager.cc:832] failed to load 'Drinks-Sku' version 1: Invalid argument: model 'Drinks-Sku', tensor 'output': the model expects 2 dimensions (shape [-1,16075]) but the model configuration specifies 2...

This may also be a silent OOM error: https://github.com/microsoft/onnxruntime/issues/10894#issuecomment-1110915026. Worth checking if reproducible. Can you reproduce this in the latest 22.08 container @heibaidaolx123? It's possible the issue has already been...

Hi @frankxyy , Please share the full error log for more info/context if you need more information. Assuming this warning is coming from TensorFlow, see this post: https://stackoverflow.com/a/43946365 It should...