warp-ctc icon indicating copy to clipboard operation
warp-ctc copied to clipboard

zero loss

Open ShangwuYao opened this issue 6 years ago • 14 comments

I am getting zero loss in calculating the CTCLoss, I don't know if it is supposed to happen. logits, labels, input_length, labels_length could be found in https://github.com/ShangwuYao/support-issues/tree/master/warpctc

ShangwuYao avatar Jun 19 '18 14:06 ShangwuYao

Same error, too..

Did you solved the problem?

Jackson-Kang avatar Jun 21 '18 19:06 Jackson-Kang

@ShangwuYao Did you solve this problem? My training loss does not decrease and all predictions are _blank characters.

guilk avatar Jun 25 '18 13:06 guilk

No, not yet

ShangwuYao avatar Jun 25 '18 14:06 ShangwuYao

Try to run the example written in README.md. Is loss still 0?

Jackson-Kang avatar Jun 25 '18 15:06 Jackson-Kang

No the example works fine.

ShangwuYao avatar Jun 25 '18 15:06 ShangwuYao

This happened to me when the number of features is less than the number of labels

FAhmedB avatar Jul 24 '18 15:07 FAhmedB

It seems that I also met the same case with @FAhmedB , when the seq-length of features is less than the seq-length of labels.

simpleoier avatar Sep 24 '18 19:09 simpleoier

same problem. but if don't use cuda the loss is normal. so I think it may be environment problem. I'm using cuda8.0, pytorch 0.4.1

MarStarck avatar Oct 15 '18 11:10 MarStarck

I installed cuda 9.0 with cudnn 7, pytorch 0.4.0 and remake and reinstall it and it is not 0 anymore!

MarStarck avatar Oct 17 '18 03:10 MarStarck

@ShangwuYao Did you solve this problem? My training loss does not decrease and all predictions are _blank characters.

My training loss fluctuates but all predictions are blank characters. Any suggestions?

jordanott avatar Nov 01 '18 04:11 jordanott

I've installed pytorch0.4.0 instead of the previous 0.2.0. And reinstalled the warpctc, and it worked like a charm.

pxkc avatar Nov 21 '18 10:11 pxkc

I have the same problem,conda environment(cudatoolkit-9.0、cudnn-7.1.2、pytorch-0.4.0、warpctc-pytorch-0.1、python-3.6.2 ) . I doubt it caused by environment, then i tried many version of toolkit, such python( 3.5、3.6) 、cuda(8、9)、cudnn(6、7)、pytorch(0.4、0.41、1.0)and so on, but still can't resolve it, any one have ideas?

wuliebucha avatar Jan 15 '19 10:01 wuliebucha

Maybe you can try this. It works for me!

niuwagege avatar Jan 16 '19 10:01 niuwagege

Maybe you can try this. It works for me!

Thanks, it works for me.

kokoyy avatar May 27 '19 09:05 kokoyy