xcyao00
whether this mod is unsupervised or self-supervised?
Hello, I would like to ask why I don't find the decoder section inside the mod of the code, is there no decoder? And I see that the paper is written with self-supervision inside, may I ask if this paper is based on reconstructed transformer or non-reconstructed transformer? Looking forward to your answer, thank you!
The transformer network is also the reconstruction network, the output is used to reconstruct the input features. The intra- and inter-branch is trained by self-supervised way, as we use the target correlation as the learning target.
The transformer network is also the reconstruction network, the output is used to reconstruct the input features. The intra- and inter-branch is trained by self-supervised way, as we use the target correlation as the learning target.
I'm sorry to bother you again, I didn't find the decoder part of this thesis code, is there no decoder or I didn't find it?