pointer_summarizer icon indicating copy to clipboard operation
pointer_summarizer copied to clipboard

Published 20 hours ago • verified publisher icon atulkum

Training saturates early?

Open ajoshi80 opened this issue 4 years ago • 3 comments

I'm using the same hypers but seeing this for my training curve. Why would this happen? Looks like the LR is too high but your curve with the same lr seems fine.

Screen Shot 2020-03-25 at 4 27 14 PM Screen Shot 2020-03-25 at 4 27 23 PM

ajoshi80 avatar Mar 25 '20 23:03 ajoshi80

This seems to be an issue with the python 3 data loading where everything is mapped to OOV

ajoshi80 avatar Mar 30 '20 19:03 ajoshi80

@ajoshi80 were you able to resolve this?

jivatneet avatar Dec 27 '20 19:12 jivatneet

@jivatneet @ajoshi80

The issue is that since Python 3 all tokens are byte variables and therefore they are recognized as OOV. Changing everything back to string representations seems to work.

malteos avatar Feb 14 '21 17:02 malteos