Selective kernel ratio hyperparameter

[slala2121]

For the SSL pretrained and supervised trained ImageNet models, what was the sk_ratio? Also, was the se_ratio = 0? What does the se_ratio represent? Thanks.

[chentingpc]

se_ratio is always 0 so you can ignore. in the released simclrv2 models, sk_ratio is set either 0 (wo sk) or 0.0625 (w sk).

[slala2121]

Thanks. Also the paper mentions it uses EMA of 0.99 and memory buffer of 64. What do these hyperparameters correspond to and how can they be set in the code?