How to use this model to generate text?

[Tylersuard]

trafficstars

Hello. I love the idea of SGConv. Would it be possible to modify the code so it can generate sequences of tokens, like in a Seq2Seq model? Thank you

[leeyeehoo]

We will try to release the implementation code in a few weeks. Basically, you can refer to transformer XL and replace the attention layer with SGConv.

[Tylersuard]

Thank you so much!