context-length topic
List
context-length repositories
LongNet
656
Stars
62
Forks
11
Watchers
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"