OpenAdapt icon indicating copy to clipboard operation
OpenAdapt copied to clipboard

Published 20 hours ago • verified publisher icon OpenAdaptAI

Implement Memorizing Transformers

Open abrichr opened this issue 1 year ago • 0 comments

Feature request

We would like to implement https://openreview.net/pdf?id=TrjbxzRcnf- via https://github.com/lucidrains/memorizing-transformers-pytorch and/or https://github.com/google-research/meliad as a completion provider.

See also https://twitter.com/ChrSzegedy/status/1589492667247132672?s=20&t=1VqJB9gI-yAmv2wM6VoYiQ

Motivation

Long term memory implemented by vector databases that are external to the model has fundamental limitations.

abrichr avatar Jul 26 '23 02:07 abrichr