infini-attention topic

List infini-attention repositories

infini-transformer

293
Stars
23
Forks
293
Watchers

PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

infini-attention

54
Stars
9
Forks
54
Watchers

An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'