transformers icon indicating copy to clipboard operation
transformers copied to clipboard
verified publisher icon huggingface

Add MegatronT5

Open eagle705 opened this issue 2 years ago • 0 comments

Model description

In NeMo Megatron, the T5 model is available, but there is currently no MegatronT5 class for huggingface, such as MegatronBERT or MegatronGPT2. I have recently finished the porting work and have tested the model internally. I would like to share this model with the community.

Open source status

  • [X] The model implementation is available
  • [ ] The model weights are available

Provide useful links for the implementation

eagle705 avatar Mar 22 '23 15:03 eagle705