bmilde

Maybe we can add an option to disable this particular warning or at least make the outputsize (500) configurable? I really like to see any other warnings, so suppressing all...

Would you accept a pull request for this? Currently my workaround is using grep -v to filter this message: tail -f exp/asr_train_asr_streaming_transformer_size_s_raw_es_bpe1024/train.log | grep -v "WARNING:root:The length of the text...

I wasn't suggesting to use grep for this :) Shouldn't be too difficult to fix this, the message comes from this code and 500 is hard coded right now: https://github.com/espnet/espnet/blob/e72ffd9f44396fd97121dc5d38893d66b18756cc/espnet2/train/preprocessor.py#L487...

Hi, Glad you were able to fix the issue. Can you share what you did or maybe even do a PR?