CTC-OptimizedLoss
CTC-OptimizedLoss copied to clipboard
TeaPoly
CTCMWER Loss may be negative sometime ?
Thankyou very much for share the code, but when I training a model using the CTCMWER loss, it may be negative, sometime? So what's the reason could be?
Thankyou very much for share the code, but when I training a model using the CTCMWER loss, it may be negative, sometime? So what's the reason could be?
https://github.com/TeaPoly/CTC-OptimizedLoss/blob/c5b0c17ce5134a6e45fed1cad1a02906932d944d/mwer_loss.py#L75
It maybe negative when re-normalized error word number.
Hi, thanks for sharing. Is it normal for a negative loss?
It is normal to observe that the loss value is getting smaller and smaller, because the average word error is subtracted when normalizing. For details, please refer to the following formula from paper https://arxiv.org/abs/1712.01818. In addition, don't use MWER loss in the initial stage of training, and try to use CTC loss for initial training.
