Nick Comly comments

Results 68 comments of


                                            Nick Comly

🐛 [Bug] aten::add does not convert with dynamic batch

bump @apbose to Naren's question

🐛 [Bug] Poor quantization accuracy of resnet50 model int8 using Torch-TRT PQT method

CC: @tanayvarshney

🐛 [Bug] Returning list of tensors fails when operations are applied to tensors: `RuntimeError: [Error thrown at core/conversion/conversion.cpp:220] List type. Only a single tensor or a TensorList type is supported.`

> @peri044 I think we decided for this case to wait for collections right? @narendasan is this a tested case by [collections ](https://github.com/pytorch/TensorRT/pull/802)for v1.2?

🐛 [Bug] Returning list of tensors fails when operations are applied to tensors: `RuntimeError: [Error thrown at core/conversion/conversion.cpp:220] List type. Only a single tensor or a TensorList type is supported.`

Closing. @chaoz-dev please reopen / file a new issue if there is still a problem.

🐛 [Bug] Can't install TorchTensorRT through pip (it installs version 0.0.0)

Torch-TRT now has CMake support from the community. Check it out & let us know what you think! #1058

🐛 [Bug] Can't install TorchTensorRT through pip (it installs version 0.0.0)

GitHub changes broke the pip distro. please see: https://github.com/pytorch/TensorRT/issues/1371#issuecomment-1256760254

[Question]Doesn't torch tensorrt support LSTM-based decoder optimization??

Hi @koliaok can you please elaborate? Are you asking if Torch-TRT supports seq2seq models? Any specific models you're looking at? > the optimized model cannot be used by inputting only...

🐛 [Bug] Segmentation Fault When Trying to Quantize ResNet50 model

@peri044 can we please confirm the PTQ notebook is working properly, then go after this bug? P1

❓ [Question] Running a same torchscript using the same input producing different results.

TensorRT performs "kernel auto-tuning" which essentially selects the fastest kernels for your models on your specific device. There can be a small amount of jitter in this step, for a...

❓ [Question] Running a same torchscript using the same input producing different results.

Hi @SeTriones, how have your other experiments gone? Is there other discrepancies in results or performance in the models you listed above which create concern for you?