pytorch-adda icon indicating copy to clipboard operation
pytorch-adda copied to clipboard

Could you verify the implementation? Acc = 11% after domain adaptation

Open lindagaw opened this issue 4 years ago • 5 comments

=== Evaluating classifier for encoded target domain ===

only source <<< Avg Loss = 14.961788177490234, Avg Accuracy = 56.140000% source and target <<< Avg Loss = 8366.6220703125, Avg Accuracy = 11.350000%

I got accuracy = 11 after domain adaptation.

lindagaw avatar Jun 06 '21 15:06 lindagaw

I set d_learning_rate = 1e-3 and c_learning_rate = 1e-5 can get a good result.

source only <<< Avg Loss = 1980.854672080592, Avg Accuracy = 75.000000% domain adaption <<< Avg Loss = 97.09941973184284, Avg Accuracy = 92.903227%

zzzpc avatar Aug 25 '21 01:08 zzzpc

I got accuracy = 8 after domain adaptation…… image

Hcshenziyang avatar Nov 27 '21 06:11 Hcshenziyang

Did you solved this issue ? I'am also facing low DA accurcay

ghost avatar Mar 15 '22 13:03 ghost

See #29

yuhui-zh15 avatar Apr 12 '22 03:04 yuhui-zh15

I think what causes the low adaptation accuracy is that the class labels are swapped by the target encoder. This makes sense because it is an unsupervised task and the target encoder didn't see the class labels.

I've used this code on 2D data: https://github.com/mashaan14/ADDA-toy

You can see in the attached image that the target encoder separates the classes well. But the class labels were swapped.

Testing target data using target encoder

mashaan14 avatar Feb 15 '23 11:02 mashaan14