Tutorial Example seems to Fail?

[picheny-nyu]

I finally managed to get wav2letter compiled on my system (heaven knows if the build was valid, but it finished).

When I try the tutorial it looks like it runs for 1 epoch/iteration and then crashes.

Here is the output to the screen:

wav2letter/build/Train train --flagsfile wav2letter/tutorials/1-librispeech_clean/train.cfg Memory Manager Stats MemoryManager type: CachingMemoryManager Number of allocated blocks:20 Size of free block pool (small):17 Size of free block pool (large):9 Total native mallocs:20 Total native frees:0

and it produces the attached files (zipped) I don't see how to turn on debugging to see where this is failing.

Please help!

files.zip

[avidov]

What is the failure that you are trying to solve ?

[picheny-nyu]

Based on what I see in the files it looks like it only ran one iteration and then stopped. It only ran for a few seconds and printed nothing to the screen.

[tlikhomanenko]

Please run with--logtostderr=1 (to have printing all intermediate loggin on the screen) and set --iters=100000 (we reported this several times in the issues on tutorial regarding our changes in the lr schedule recently, iters is now setting number of updates not epochs, and in tutorial it is set to 25, which is 25 updates).

Memory info printed on the screen is just info about memory behaviour, so don't be worry about it.

[picheny-nyu]

I assume the flags go in the flags file? It claims it does not know the flag "logtostderr" when I place it on command line. Settting iters=100000 makes it do more stuff, for sure.

[tlikhomanenko]

Hmm, strange, should work --logtostderr=1 either you add into flagsfile or specify in cmd line.