first-order-model icon indicating copy to clipboard operation
first-order-model copied to clipboard

Any special reasons for using id sampling in dataloader

Open Cold-Winter opened this issue 3 years ago • 3 comments

Great work! Thanks for releasing the code again. I notice that you are using id sampling in dataloader to ensure one batch have different persons. Why did you do this, why not just shuffle all the videos?

Best, Yandong

Cold-Winter avatar May 26 '21 20:05 Cold-Winter

The dataset is pretty imbalanced, so one identity could have ~100 videos, while other could have 1. But to be honest I implement this from the very beginning and did not check if it works without it.

AliaksandrSiarohin avatar May 26 '21 21:05 AliaksandrSiarohin

Thanks for the quick response. I trained different experiments with the same hyper-parameters and find that they all get very different faces in various quality. Some of them even failed. Do you observe the same issues?

Cold-Winter avatar May 26 '21 21:05 Cold-Winter

That is weird usually I get more or less the same results. At least in the terms of loss.

AliaksandrSiarohin avatar May 26 '21 22:05 AliaksandrSiarohin