attention Is there tensorflow implementation of sparse attention?

Is there tensorflow implementation of sparse attention?

Open hugddygff opened this issue 4 years ago • 3 comments

Thanks.

Oct 03 '19 01:10 hugddygff

sorry for no~

you can try https://github.com/openai/sparse_attention directly

Oct 16 '19 02:10 bojone

emmm, I do not like the official implementation.

I have tried to change the keras version to tensorflow, and found it easy to change.

Oct 16 '19 03:10 hugddygff

@hugddygff Hi, sorry have you found the sparse attention using Keras or TensorFlow

Mar 15 '21 19:03 rebeen