channel-spatial-temporal prompt

[yujialele]

Thank you for your good work! I recently have read your code and generated some questions. I find that channel-spatial cross-attention module is projected into multi-head attention and the FFN in each Swin-transformer blocks, but temporal prompt is only used in the last Swin-transformer block. This is not quite consistent with the text description in your paper.