TensorRT
TensorRT copied to clipboard
✨[Feature] Handling Scalar type outputs on the boundry between TensorRT and PyTorch subgraphs
Is your feature request related to a problem? Please describe.
See https://github.com/pytorch/TensorRT/pull/2752 for an example. Some operators return a scalar, if these are on the graph boundary there may be issues in the runtime.
Describe the solution you'd like
Describe alternatives you've considered
Additional context