long-context topic
lloco
The official repo for "LLoCo: Learning Long Contexts Offline"
Ada-LEval
The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"
infini-transformer-pytorch
Implementation of Infini-Transformer in Pytorch
Counting-Stars
Counting-Stars (★)
awesome-llm-plaza
awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.
Q-LLM
This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
MM-NIAH
This is the official implementation of the paper "Needle In A Multimodal Haystack"
Ms-PoE
"Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zh...
VideoLLaMB
Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
LongWriter
LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs