graph4nlp icon indicating copy to clipboard operation
graph4nlp copied to clipboard

Support for transformer as the decoder

Open smith-co opened this issue 3 years ago • 1 comments

🚀 Feature

In the current implementation, RNNs are used as the decoder.

I think it would be great to have Transformer as the decoder.

Wondering whether this feature is already under consideration.

Also if support the transformer implementation, when that feature would be availble?

smith-co avatar Aug 03 '22 19:08 smith-co

Thanks for your interest in the library. We agree that transformer is needed and it is on schedule. I have replied it in https://github.com/graph4ai/graph4nlp/issues/496#issuecomment-1207130759.

AlanSwift avatar Aug 06 '22 11:08 AlanSwift