demuxin
demuxin
I use TensorRT9.2 and opset18, the LayerNormalization problem doesn't occur anymore. But there is an error with the col2im plugin. This error does not occur on TensorRT8.5, Could you please...
unfortunately, no, I've been busy with other things recently.
> > We don't support data-dependent shapes for plugin currently. The output shape must be able to compute from inputs' shape. > > what's the meaning of data-dependent shapes, could...
> We don't support data-dependent shapes for plugin currently. The output shape must be able to compute from inputs' shape. Hi @zerollzeng , is this feature currently supported ?
> 文末链接404 已解决
Moreover, when the model infers using forward function, there are these warnings: ``` WARNING: [Torch-TensorRT] - Using default stream in enqueue()/enqueueV2()/enqueueV3() may lead to performance issues due to additional cudaDeviceSynchronize()...
Hi @gs-olive, this is not right, there is complie error: ``` error: ‘set_multi_device_safe_mode’ is not a member of ‘torch_tensorrt::core::runtime’ 27 | torch_tensorrt::core::runtime::set_multi_device_safe_mode(true); ```
This is a similar compilation error. ``` error: ‘torch::ops’ has not been declared 24 | torch::ops::tensorrt::get_multi_device_safe_mode(true); ``` I searched the libtorch and torch-TensorRT header files, and there are no functions...
> It is because torch-trt dont support % op, you need to change % to int(a - b * torch.floor(torch.div(a, b))), the compute is the same, but can convert by...