shanppp

big performance difference on tensorRT

4

Hi, I just tried the demo code below, in your result, the [TensorRT (FP16)] result is much better than others. However, the results I got are quite different. there is...

🐛 [Bug] Encountered bug when using Torch-TensorRT

5

## Bug Description RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument index in method...