Jianquan Ye

Is it possible to collect state dict in cpu?

2

When I finish one epoch in trianing, the main_worker function will call ts.collect_state_dict(model, state_dict). But because the limit of GPU resource, it will raise Out of Memory in my machine,...

It seems that the released code did not implement 'stochastic depth' in CoAtNet module, but it was mentioned in the appedix A.2 of paper.

What does the 600 means?

4

Hi,thank you for sharing this excellent repertory ! But when I want to eval my model, I have a question, what does the number 600 means in the ./dataset/lfw.py Line...

merge_type = "tsharpen" cause "nan"

4

I use the example like: model = tta.SegmentationTTAWrapper(model, tta.aliases.d4_transform(), merge_mode="tsharpen") when I use this model to predict, I found the output of model has value "nan"... I look up the...

About the CKA similarity

1

Is it any implementation of calculating CKA similarity, which is mentioned in paper?