Merge Partial FC

[anti-machinee]

insightface published 8 checkpoint of partial fc. Each checkpoint corresponds to a part of FC layer. For example, glint360k has 360000 identities. Each checkpoint has shape (360000/8, 512). Please help me

1. How can I merge all of 8 checkpoints to one fc? Because I want to use full FC layer for pretrained
2. If I have 3 gpus, how can I load 8 checkpoints to 3 gpus? Thank you

[jacqueline-weng]

For pretrained, I think you can just load each partial fc weight file separately for each gpu when training starts. The problem only occurs when you use different number of gpus from pretrained. In this case, maybe you can look into the structure of partial fc files to see if you can concatenate them.