gluon-nlp icon indicating copy to clipboard operation
gluon-nlp copied to clipboard

[Model] Add Performer

Open sxjscience opened this issue 5 years ago • 0 comments

Description

Add Performer to our model zoo:

Code in flax: https://github.com/google-research/google-research/tree/master/performer/fast_self_attention

Some reference implementations in PyTorch: https://github.com/lucidrains/performer-pytorch

One choice is to add a pytorch-based model.

sxjscience avatar Nov 02 '20 23:11 sxjscience