onnxruntime_backend icon indicating copy to clipboard operation
onnxruntime_backend copied to clipboard

onnxruntime inference seesion params setting

Open zhaozhiming37 opened this issue 3 years ago • 0 comments
trafficstars

Background:

My onnx model include Dropout, which is executed as training mode.However, onnxruntime will optimize Dropout ops by default.So, I calls session = ort.InferenceSession(modelPath, disabled_optimizers=["EliminateDropout"]) to avoid that.

Question:

What should I do, when I deploy my model inference service by triton to achieve my goal. Thanks a lot!

zhaozhiming37 avatar Jul 29 '22 09:07 zhaozhiming37