Gennaro Vaccaro

T5 Model with TensorRT - Runtime on GPU

14

Hi, In reference to [#10807](https://github.com/microsoft/onnxruntime/issues/10807), I'm trying to use my own T5-base on TensorRT. My model has a `max_length=1024`, and using TensorRT (I created the TensorRT container) I have worse...

FlanT5 training and zero tensors

10

Hi, I'm training a FlanT5 network. The training completes successfully, but when I try to run a simple inference, I have a tensor of zeros, so the prediction is null....

Issue with onnxruntime

4

Hello, I have a dependency problem between `fastt`5 and `onnxruntime` libraries on mac M2 chip. Specifically, the version required by fastt5 is `onnxruntime==1.10.0`, while, as I have read, `onnxruntime>=1.12.0` is...

ILQL training batch2 tensor dimensions error

2

Hi, I'm trying an ILQL training with a gpt-j network trained with [this](https://github.com/CarperAI/trlx/blob/main/examples/summarize_rlhf/sft/train_gptj_summarize.py) code. I don't have this problem with the [original pre-trained net](https://huggingface.co/EleutherAI/gpt-j-6b), nor with a flan-xl. ``` Traceback...

Generic Flan-T5 RL training

3

Hello, I tried to use this library to train a FLAN-T5. I have seen that as examples there are sentiment analysis or summarization tasks, but in my case it is...