Pavlo Molchanov comments

Repositories
Issues
Comments

Results 3 comments of


                                            Pavlo Molchanov

Questions on the KD process on CIFAR10 dataset

Answering your questions: 1. For these experiments we generated 1000 batches of batch size 256 in total. DI/ADI generate the entire batch of data at once. Most likely hyper parameters...

Code for Other Experiments

We have restrictions on providing trained models and this complicates full code release. Most likely we will release experiment for 2. Data-free Knowledge Transfer soon and will try to do...

What is the KD temperature in the CIFAR10 experiment

Hi, the temperature used was set to the default value of 3 and never changed. We will take into consideration the need to share details on KD training for Cifar10...