onnxruntime_backend icon indicating copy to clipboard operation
onnxruntime_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

Dynamic CUDA and TRT options updating

Open gedoensmax opened this issue 1 year ago • 1 comments
trafficstars

@pranavsharma this is solving #217 and some other issues that are asking for more option support. I have not tested this change, do you have any recommendation on how to test ? I have next to no triton experience.

gedoensmax avatar Feb 29 '24 12:02 gedoensmax

@yf711 fyi

jywu-msft avatar Mar 05 '24 21:03 jywu-msft