models icon indicating copy to clipboard operation
models copied to clipboard

Files and documentation for training a T5 model from scratch

Open khatchad opened this issue 1 year ago • 0 comments

Prerequisites

Please answer the following question for yourself before submitting an issue.

  • [X] I checked to make sure that this feature has not been requested already.

1. The entire URL of the file you are using

https://github.com/tensorflow/models/blob/master/official/nlp/train.py

2. Describe the feature you request

There is documentation and supporting files (experiments) for training other NLP models, but I couldn't find too specific of information for training a T5 model using train.py.

3. Additional context

It would be very helpful to have example experiment and task files for T5, i.e., https://github.com/tensorflow/models/blob/master/official/nlp/modeling/models/t5.py.

4. Are you willing to contribute it? (Yes or No)

No, I don't have the background.

khatchad avatar Feb 21 '25 19:02 khatchad