Amirreza Dolatpour Fathkouhi
Amirreza Dolatpour Fathkouhi
Hi, thank you for sharing the code. why did not you use sine-cosine positional embedding as it is mentioned in the paper?
Sure, in the paper https://arxiv.org/abs/2111.06377, on page 11, first paragraph. 
https://github.com/facebookresearch/mae/blob/main/models_mae.py You can see that they utilized the frozen positional embedding using the sine-cosine approach.
Based on what I studied, we do not have specific rules for choosing the positional embedding. However, I want to try the sine-cosine approach, and see the result. If I...