Kiran R

Out of memeory error for batch size more than 1 for T5 models.

15

hey, first of all, thanks for creating this amazing library! I'm following your T5 implementation with trt, https://github.com/ELS-RD/transformer-deploy/blob/b52850dce004212225edcaa7b80fccc311398038/t5.py#L222 And, I'm trying to convert the onnx version of the T5 model...