Learning-Loss-for-Active-Learning icon indicating copy to clipboard operation
Learning-Loss-for-Active-Learning copied to clipboard

question about then loss function

Open blue-xuhu opened this issue 3 years ago • 3 comments

hello i,read your code.i have some question. Is the loss function unique? is the way you do about loss function same with Original author? i am not sure about this and the paper don't say it clearly yet

blue-xuhu avatar Aug 21 '20 07:08 blue-xuhu

Yeah, the loss function I implemented in this repository is exactly the same as the one in the reference paper. Take a look at the formula (2) on page 96. LL4AL paper link If you mean the 'target loss' for the CIFAR10 classification task, I think the authors use cross-entropy loss according to the 3rd-6th line of page 98. Since the cross-entropy loss is a typical choice for the CIFAR10 classification task.

Mephisto405 avatar Aug 21 '20 08:08 Mephisto405

Thanks for your reply about loss loss function。 I ran into another problem during the experiment。When using the initialized data set for the first training on the paper,The method of this paper and other methods have achieved almost the same accuracy。I refer to your code, tried many times but couldn't do this. The method in this paper uses the target model and lossnet, while other methods only use the target model. So how did they get the same accuracy in the first training?

blue-xuhu avatar Aug 22 '20 11:08 blue-xuhu

Thanks for your reply about loss loss function。 I ran into another problem during the experiment。When using the initialized data set for the first training on the paper,The method of this paper and other methods have achieved almost the same accuracy。I refer to your code, tried many times but couldn't do this. The method in this paper uses the target model and lossnet, while other methods only use the target model. So how did they get the same accuracy in the first training?

helllo,did you finish the problem?

Bardielz avatar Dec 02 '20 07:12 Bardielz