PaddlePaddle-Swin-Transformer-V2 icon indicating copy to clipboard operation
PaddlePaddle-Swin-Transformer-V2 copied to clipboard

Published 20 hours ago • verified publisher icon nku-shengzheliu

有无pytorch版本？

Open nullxjx opened this issue 3 years ago • 3 comments

如题

nullxjx avatar Dec 24 '21 11:12 nullxjx

可以参考pytorch与paddle算子映射表对代码进行修改。后面我如果时间的话会修改一下对应的torch的模型文件放上来

nku-shengzheliu avatar Dec 24 '21 11:12 nku-shengzheliu

可以参考代码改动说明中的2. Attention计算方式。对应swin_transformer.py的343~348行

nku-shengzheliu avatar Dec 28 '21 10:12 nku-shengzheliu

https://github.com/nku-shengzheliu/PaddlePaddle-Swin-Transformer-V2/blob/42eb8b82098ef96159a5a1872b48185389731ae1/swin_transformer.py#L344-L347 这四行代码计算了qi和kj之间的余弦相似度，最终的attn范围已经是[-1,1]

nku-shengzheliu avatar Dec 29 '21 02:12 nku-shengzheliu