PixPro icon indicating copy to clipboard operation
PixPro copied to clipboard

the pre-training loss

Open jancylee opened this issue 3 years ago • 10 comments

The pre-training losses are always negative (like -199.03), is that normal?

jancylee avatar May 10 '21 04:05 jancylee

The pre-training losses are always negative (like -199.03), is that normal?

I got the negative loss also, have you solve it?

merlinarer avatar May 16 '21 15:05 merlinarer

Not yet.

jancylee avatar May 17 '21 01:05 jancylee

Have you worked it out? What should be the correct loss?

yinjunbo avatar Jun 30 '21 05:06 yinjunbo

Anyone reproduced the results or solved the negative loss issue?

jxhuang0508 avatar Jul 22 '21 01:07 jxhuang0508

Anyone konw something about the negative loss? Is that right?

jianglianEin avatar Oct 11 '21 07:10 jianglianEin

Hi, do you mean the value of loss is negative?

If this is the point, this is right for PixPro. You may check the implementation of this line https://github.com/zdaxie/PixPro/blob/main/contrast/models/PixPro.py#L204 .

impiga avatar Oct 13 '21 14:10 impiga

Hi, If I understand correctly, this regreission loss only includes the pushing force with aligning spatial corresponding pixel. So where is the repulsing force as in Eqn2?

xiao7199 avatar Oct 27 '21 17:10 xiao7199

why negative loss?

ZHEGG avatar Mar 07 '22 09:03 ZHEGG

same question.

shiyongde avatar Jun 16 '22 01:06 shiyongde

I carefully studied the code. The loss of this implementation seems different from the paper. It does not apply constractive loss.

douyimin avatar Oct 07 '22 06:10 douyimin