main.py doesn't exit after 'Start testing...'

[darkkhen]

Hi

After running a model, the script halts on 'start testing'. The script has been executed (I get results etc), however it doesn't exit like it should be. I think it never enters the 'end_reached = true' state.

Kind regards, Ken

[lverwimp]

Hi Ken,

Could you provide me the config file that you used, as well as the size of the dataset that you are testing on (number of words)?

Best, Lyan

Van: "darkkhen" [email protected] Aan: "lverwimp/tf-lm" [email protected] Cc: "Subscribed" [email protected] Verzonden: Donderdag 22 november 2018 10:59:31 Onderwerp: [lverwimp/tf-lm] main.py doesn't exit after 'Start testing...' (#7)

Hi

After running a model, the script halts on 'start testing'. The script has been executed (I get results etc), however it doesn't exit like it should be. I think it never enters the 'end_reached = true' state.

Kind regards, Ken

— You are receiving this because you are subscribed to this thread. Reply to this email directly, [ https://github.com/lverwimp/tf-lm/issues/7 | view it on GitHub ] , or [ https://github.com/notifications/unsubscribe-auth/APANLIg-JWFs21ctZafQ7TCeUMhknTuLks5uxnWDgaJpZM4YvAzX | mute the thread ] .

[darkkhen]

Hi Lyan

Thank you for your fast reply.

Below you can find the config file (eng-wiki_ferre_word_sentence_debug2.txt) and the input text (63 words).

eng-wiki_ferre_word_sentence_debug2.txt test.txt

[lverwimp]

I tried to replicate this with your config file and test set, but in my test the script stopped like it should.

The 2 most likely causes are:

• in run_epoch.py line 435: if the counter is never increased (happens on line 514), then it will never break out of the while-loop
• in main.py line 406: if end_reached is never True, it will never break out of the while loop

Could you check which of these happens? You can do this by verifying the values of counter in run_epoch.py and end_reached in main.py.

Van: "darkkhen" [email protected] Aan: "lverwimp/tf-lm" [email protected] Cc: "lyan" [email protected], "Comment" [email protected] Verzonden: Donderdag 22 november 2018 11:39:19 Onderwerp: Re: [lverwimp/tf-lm] main.py doesn't exit after 'Start testing...' (#7)

Hi Lyan

Thank you for your fast reply.

Below you can find the config file (eng-wiki_ferre_word_sentence_debug2.txt) and the input text (63 words).

[ https://github.com/lverwimp/tf-lm/files/2607602/eng-wiki_ferre_word_sentence_debug2.txt | eng-wiki_ferre_word_sentence_debug2.txt ] [ https://github.com/lverwimp/tf-lm/files/2607603/test.txt | test.txt ]

— You are receiving this because you commented. Reply to this email directly, [ https://github.com/lverwimp/tf-lm/issues/7#issuecomment-440988310 | view it on GitHub ] , or [ https://github.com/notifications/unsubscribe-auth/APANLId1Ew6qMnquO82x0B-AZ_9cyvkDks5uxn7XgaJpZM4YvAzX | mute the thread ] .

[darkkhen]

I printed the counter and it increases with 1 for each word (+1 at the very end). It won't however break on line 435.

I printed the results (print(next_word, counter, len(hypothesis))) and never get the ' </s>' as a value for next_word nor does the counter variable exceed the len(hypothesis).

[lverwimp]

What do you mean with +1 at the very end? Can you show me the output?