Longyue Wang

icon indicating a website link www.longyuewang.com icon indicating an email [email protected]

icon company Tencent AI Lab icon location Shenzhen, China icon location Ph.D., Machine Translation and Natural Language Processing

Results 2 comments of Longyue Wang

In convit.py file, where does ConVit come from, really?

> Thanks for your comments on our "Convolutional SANs" (https://arxiv.org/abs/1904.03107). We are also very happy to see this can inspire your work. The paper on analyzing Vision Transformers is really...

In convit.py file, where does ConVit come from, really?

> Hi, > > I was inspired by ["Convolutional Self-Attention Networks"](https://arxiv.org/abs/1904.03107) [2], and implemented the two-dimensional `ConViT` model for vision tasks from scratch. Yang et al. [2] mainly proposed one-dimensional...