x-transformers icon indicating copy to clipboard operation
x-transformers copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains

Can you share the code implementation of this article"Augmenting Self-attention with Persistent Memory"?

Open 1005183361 opened this issue 3 years ago • 3 comments

Looking forward to your help！

1005183361 avatar Dec 03 '21 08:12 1005183361

@1005183361 oh hey, it should be in the repository already https://github.com/lucidrains/x-transformers#augmenting-self-attention-with-persistent-memory

lucidrains avatar Dec 03 '21 18:12 lucidrains

just follow this thread of logic https://github.com/lucidrains/x-transformers/blob/main/x_transformers/x_transformers.py#L488

lucidrains avatar Dec 03 '21 18:12 lucidrains

just follow this thread of logic https://github.com/lucidrains/x-transformers/blob/main/x_transformers/x_transformers.py#L488

Thank you for your contributions and answers！！

1005183361 avatar Dec 06 '21 11:12 1005183361