Anurag Dixit comments

Results 25 comments of


                                            Anurag Dixit

❓ [Question] How to load a TRT_Module in python environment on Windows which has been compiled on C++ Windows ?

@noman-anjum-retro: Can you try this? I added the option in torchtrtc to support custom torch op or torch_tensorrt converter. I have used windows.h header file and LoadLibrary for loading the...

❓ [Question] How to load a TRT_Module in python environment on Windows which has been compiled on C++ Windows ?

It seems to be complaining about the FileNotFound IIRC, in Windows, the paths are mentioned as: \\src\\exploration\\action_recognition\\torchtrt_runtime.dll Can you try above and share your observation?

❓ [Question] How to load a TRT_Module in python environment on Windows which has been compiled on C++ Windows ?

Hi @noman-anjum-retro, I think the problem is with the mode while you are trying to load the symbol tables. I tried following and is working: ``` import ctypes import torch...

🐛 [Bug] High accuracy decrase with torch f32 model and torch_tensorrt f32 model

@kyikiwang : Where are you comparing the predictions? I see latency benchmark comparisons in the code snippet you shared here. Can you please share the workflow you are using to...

❓ [Question] Runtime check of the inference platform FP16 support

@narendasan: We can make a check for precision request against the SM compute capability as per support matrix. Something like https://docs.nvidia.com/deeplearning/tensorrt/support-matrix/index.html#hardware-precision-matrix This check will be done at runtime though.

❓ [Question] Runtime check of the inference platform FP16 support

I don't think we can do anything other than throwing an error instead of letting it crash. IIRC If the engines are not portable across computing capability, TensorRT fails at...

🐛 [Bug] Can't build Docker image on Windows.

> ## Bug Description > I'm completely new to Docker but, after trying unsuccessfully to install Torch-TensorRT with its dependencies, I wanted to try this approach. However, when I try...

fix: Fix deconv kernel channel num_output_maps where wts are ITensor

Hi @bowang007 Request you to please review this PR for merge?

❓ [Question] Output shape error in deconvolution layer when model is quantized with pytorch-quantization and using torch-tensorrt via torchscript

@oazeybekoglu : Just curious, does my [PR](https://github.com/pytorch/TensorRT/pull/2678) fixes your issue?

❓ [Question] Output shape error in deconvolution layer when model is quantized with pytorch-quantization and using torch-tensorrt via torchscript

> > @oazeybekoglu : Just curious, does my [PR](https://github.com/pytorch/TensorRT/pull/2678) fixes your issue? > > Hey @andi4191, yes it fixes the issue. @oazeybekoglu : Thank you for confirming. @peri044: Please let...