Will you support T5 or GPT based models in the future

[HyeondeyKim]

I wonder how can I use T5 with jiant, is it possible?

[jeswan]

@zphang @HaokunLiu Are T5 or GPT on your research roadmaps?

[zphang]

We have yet to considered T5 because of the memory requirements of the largest models, but it should be feasible to incorporate within the current framework. We have also considered GPT-* but because of the way we handle task preprocessing, we are unlikely to implement it until after a Tokenizer-based refactor.

So both models are likely to be supported in the future, but no earlier than the end of the year.

[jeswan]

@HyeondeyKim Are you interested in integrating T5 with jiant? If so, I can sketch out how this would be done.

[nlpist]

@jeswan I wonder about T5 integration into jiant, do you think it can be implemented in the near future?

[jian-mo]

@HyeondeyKim Are you interested in integrating T5 with jiant? If so, I can sketch out how this would be done.

Hi @jeswan I'm interested in implement t5 in the framework. Can you give me some hints?

[4r7ur-sid]

Hey guys any update on this ? I am looking to integrate T5 or GPT2 with JIANT. Any tips to get started will be deeply appreciated. @zphang @jeswan

[zphang]

Hi,

This repo is no longer being actively maintained, so we have no plans to add support for T5 and GPT-2 now.