rotary-position-embedding topic

List rotary-position-embedding repositories

CLEX

72
Stars
11
Forks
Watchers

[ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models

verified publisher icon DAMO-NLP-SG

rope-vit

174
Stars
2
Forks
Watchers

[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"

verified publisher icon naver-ai