DeepCORAL icon indicating copy to clipboard operation
DeepCORAL copied to clipboard

The reason for setting _lambda ascending ?

Open huster-wgm opened this issue 7 years ago • 1 comments

I just run the code using default setting of weight of _lambda , and i observe very tiny difference between testing accuracy of source and target. In the other hand, fixed value of 1 shows better result.

result of ascending _lambda ( _lambda = (e+1)/EPOCHS)

ascending lambda

result of descending _lambda ( _lambda = (EPOCHS-e)/EPOCHS)

descending lambda

result of fixed _lambda ( _lambda = 1)

fixed lambda 1

huster-wgm avatar Dec 15 '17 12:12 huster-wgm

I set the lambda ascending is because I want to focus on classification task at the beginning. In the original paper, the lambda is set in such way that at the end of training the classication loss and CORAL loss are roughly the same.

I think my linear lambda maybe too naive, or use a fixed lambda as your suggestion. Thanks!

SSARCandy avatar Dec 16 '17 03:12 SSARCandy