2D-Positional-Encoding-Vision-Transformer
2D-Positional-Encoding-Vision-Transformer copied to clipboard
PyTorch implementation of 2D Positional Encodings for Vision Transformers (ViT). Positional Encodings/Embeddings: Sinusoidal (Absolute), Learnable, Relative and Rotation (Rope).