about attention

[majun19970125]

Hello, I would like to ask how this attention is handled and what is the code?

[senmaoy]

It is implemented in D_GET_LOGITS_att in the model.py

[majun19970125]

So how does his final result show?is the effect of attention.

[senmaoy]

As shown in the paper, compared with rat, attention makes a little improvement. According to my results, it works more obviously in worse baselines or 64*64 resolution.

[majun19970125]

I want to reproduce the code now, but there is no code for the display effect of the attention block. How to do it?

[senmaoy]

Thank you for you interest, i will upload the visulization code of attention and rat

[majun19970125]

Can you update it now, I'm in a hurry, thank you

[senmaoy]

Wait me for about half an hour. What'more, a major contribution of this attention is sovling the model collapse caused by attention in the Discriminator. It's the first attention in D.

[majun19970125]

ok， thank you

[senmaoy]

hey it's here: https://github.com/senmaoy/RAT-GAN/blob/main/code/main_visulize_of_attenion

[senmaoy]

This code is ugly and you may propably debug by yourself. I will refine it later

[senmaoy]

Sorry, I find that my spatial attention module is still unstable. Falling back to the baseline discriminator usually leads to better performance