TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

✨[Feature] Support ShapeTensor I/O

Open peri044 opened this issue 2 years ago • 0 comments

Is your feature request related to a problem? Please describe. Currently if a network takes an input tensor which is used as shape for other layers in the graph, a shape optimization profile has to be set for this input. Eg: In the case of dynamic shapes + fallback, sym_int layers fallback to Pytorch which are passed as inputs to other subgraphs. The min, opt, max values for sym_int inputs need to be set at compile time for TensorRT to pass.

Describe the solution you'd like

Describe alternatives you've considered

Additional context

peri044 avatar Sep 07 '23 20:09 peri044