Elchin

I also tried `trtexec` of version 8.6, 7.x and the same error occurs

I run with such command ` /usr/src/tensorrt/bin/trtexec --onnx=generator.onnx --minShapes=text_emb:1x1x192,q_labels:1x1x5,bert_emb:1x1x768,speaker_ids:1,noise_scale:1,noise_scale_w:1,length_scale:1x1 --optShapes=text_emb:1x400x192,q_labels:1x400x5,bert_emb:1x50x768,speaker_ids:1,noise_scale:1,noise_scale_w:1,length_scale:1x400 --maxShapes=text_emb:1x400x192,q_labels:1x400x5,bert_emb:1x50x768,speaker_ids:1,noise_scale:1,noise_scale_w:1,length_scale:1x400 --workspace=30000 `

I saw somewhere about RandomNormalLike, but as I remember solution was just update tensorrt

Any updates? I've encountered similar issue using TRT 9.2.0.5. It's also about `StochasticDurationPredictor` module (https://github.com/jaywalnut310/vits/blob/main/models.py#L17), as in your output with `RandomNormalLike` ``` [02/27/2024-12:21:40] [W] [TRT] /dp/flows.3/Reshape_26: IShuffleLayer with zeroIsPlaceHolder=true has...

It doesn't help. I got the same error ``` [03/05/2024-10:41:25] [TRT] [I] Graph optimization time: 0.513168 seconds. [03/05/2024-10:41:25] [TRT] [W] BuilderFlag::kENABLE_TACTIC_HEURISTIC has been ignored in this builder run. This feature...

May be it will help: If I split this module to two modules by this line https://github.com/jaywalnut310/vits/blob/main/models.py#L515. i.e. first module have code https://github.com/jaywalnut310/vits/blob/main/models.py#L501-L514 And second https://github.com/jaywalnut310/vits/blob/main/models.py#L515-L522 Then two modules converted...

RandomNormalLike was from here https://github.com/jaywalnut310/vits/blob/main/models.py#L90 I replaced that line with ```python z = torch.randn(x.size(0), 2, x.size(2)).to(device=x.device, dtype=x.dtype) # (b, 2, t) z = z.unsqueeze(1) # (b, 1, 2, t) z...