Kris Hung comments

Results 129 comments of


                                            Kris Hung

Unexpected shape for input 'TEXT' for model 'ensemble_model'. Expected [-1,-1], got [2]

Closing issue due to lack of activity. Please re-open the issue if you would like to follow up with this.

Can't build the Dockerfile.win10.min

@NikolaVrbanic171 We updated the windows dockerfile recently. Please try it out and feel free to let us know if you are still seeing the same issue.

failed to open CUDA IPC handle: invalid argument

Closing due to lack of activity. Please re-open the issue if you would like to follow up with this issue.

build error: The batch manager library is truncated or incomplete

Closing due to lack of activity. Please re-open the issue if you would like to follow up with this issue.

On server/deploy/oci -> running "helm install example ." to deploy the Inference Server and pod doesn't get to running due to Liveness probe failed & Readiness probe failed

Closing due to lack of activity. Please re-open the issue if you would like to follow up with this issue.

Cannot use model-analyzer on ONNX classification model with dynamic input

From the log it seems like the input shape needs to be specified: ``` error: Failed to init manager inputs: input input contains dynamic shape, provide shapes to send along...

update openvino to 2024.0.0

@tanmayv25 I will merge this PR once we the PR for ONNX+OV2024 support is ready.

update openvino to 2024.0.0

@dtrawins Thanks for the contribution! I've merged the same changes in the other PR to resolve some merge conflicts. Closing this PR.

How to extract model states stored in Triton (Implicit State Management)

Closing due to lack of activity. Please re-open the issue if you would like to follow up with this issue.

How to specify the TensorRT version in Triton Server for inference?

@Prots 24.05 will be released at the end of month, which will be later this week or early next week I believe.