Dheeraj Peri

🐛 [Bug] Implement dynamic batch and dynamic shapes support for layer norm converter

1

## Bug Description Implement dynamic batch and dynamic shapes support for layer norm converter. Add the following testcase once it is implemented ```py def test_layernorm_with_dynamic_shape(self): class LayerNorm(torch.nn.Module): def forward(self, x):...

🐛 [Bug] scaled_dot_product_attention test in Torchscript failure

2

## Bug Description //tests/core/conversion/converters:test_scaled_dot_product_attention (C++ exception with description "0 INTERNAL ASSERT FAILED at "../torch/csrc/jit/ir/alias_analysis.cpp":615, please report a bug to PyTorch. We don't have an op for aten::scaled_dot_product_attention but it isn't...

## Bug Description Observing threshold failures. Test passes occasionally. FAILED lowering/test_aten_lowering_passes.py::TestLowerLinear::test_lower_linear - AssertionError: 0.00113677978515625 != 0 within 4 places (0.00113677978515625 difference) : Linear TRT outputs don't match with the original...

**Is your feature request related to a problem? Please describe.** Our current workflow ```py ep = torch.export.export(model, (inputs,)) trt_gm = torch_tensorrt.dynamo.compile(ep, inputs=[inputs]) torch_tensorrt.save(trt_gm, "trt.ep", inputs=[inputs]) ``` Desired workflow: ```py ep...

# Description Cherry pick of https://github.com/pytorch/TensorRT/pull/2709. Credits to @gcuendet Fixes # (issue) ## Type of change Please delete options that are not relevant and/or add your own. - Bug fix...

# Description Cherry pick of https://github.com/pytorch/TensorRT/pull/2796 Fixes # (issue) ## Type of change Please delete options that are not relevant and/or add your own. - Bug fix (non-breaking change which...

🐛 [Bug] torch.export fails to export embedding_bag_aten layer in a standalone test

2

## Bug Description Error message: ```py torch._dynamo.exc.UserError: Cannot export model which references tensors that are neither buffers/parameters/constants nor are direct inputs. For each tensor, if you'd like this tensor to...

# Description Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change....

# Description Pytorch had export serde bugs which were fixed in nightly. This PR re-enables the disabled tests. Fixes # (issue) ## Type of change Please delete options that are...