Waiting for EOS from decoder

[charlesjankowski]

From time to time I get the "Waiting for EOS from decoder" in /opt/worker.log as below.

Any ideas why?

Thanks!

2019-03-26 23:00:03 - DEBUG: main: : Got message from server of type <class 'ws4py.messaging.TextMessage'> 2019-03-26 23:00:03 - INFO: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Initializing request 2019-03-26 23:00:03 - INFO: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Setting caps to audio/x-raw, layout=(string)interleaved, rate=(int)16000, format=(string)S16LE, channels=(int)1 2019-03-26 23:00:03 - INFO: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Connecting audio decoder 2019-03-26 23:00:03 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Started timeout guard 2019-03-26 23:00:03 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Checking that decoder hasn't been silent for more than 5 seconds 2019-03-26 23:00:03 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Initialized request 2019-03-26 23:00:03 - INFO: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Connected audio decoder 2019-03-26 23:00:03 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Got message from server of type <class 'ws4py.messaging.BinaryMessage'> 2019-03-26 23:00:03 - DEBUG: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Pushing buffer of size 4800 to pipeline 2019-03-26 23:00:03 - DEBUG: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Pushing buffer done 2019-03-26 23:00:03 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Got message from server of type <class 'ws4py.messaging.BinaryMessage'> 2019-03-26 23:00:03 - DEBUG: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Pushing buffer of size 4800 to pipeline 2019-03-26 23:00:03 - DEBUG: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Pushing buffer done 2019-03-26 23:00:03 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Got message from server of type <class 'ws4py.messaging.BinaryMessage'> 2019-03-26 23:00:03 - DEBUG: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Pushing buffer of size 4800 to pipeline 2019-03-26 23:00:03 - DEBUG: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Pushing buffer done 2019-03-26 23:00:03 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Got message from server of type <class 'ws4py.messaging.BinaryMessage'> 2019-03-26 23:00:03 - DEBUG: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Pushing buffer of size 4800 to pipeline 2019-03-26 23:00:03 - DEBUG: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Pushing buffer done 2019-03-26 23:00:03 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Got message from server of type <class 'ws4py.messaging.TextMessage'> 2019-03-26 23:00:03 - INFO: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Pushing EOS to pipeline 2019-03-26 23:00:04 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Checking that decoder hasn't been silent for more than 5 seconds 2019-03-26 23:00:05 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Checking that decoder hasn't been silent for more than 5 seconds 2019-03-26 23:00:06 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Checking that decoder hasn't been silent for more than 5 seconds 2019-03-26 23:00:07 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Checking that decoder hasn't been silent for more than 5 seconds 2019-03-26 23:00:08 - WARNING: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: More than 5 seconds from last decoder hypothesis update, cancelling 2019-03-26 23:00:08 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Master disconnected before decoder reached EOS? 2019-03-26 23:00:08 - INFO: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Sending EOS to pipeline in order to cancel processing 2019-03-26 23:00:08 - INFO: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Cancelled pipeline 2019-03-26 23:00:08 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:09 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:10 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:11 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:12 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:13 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:14 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:15 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:16 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:17 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:18 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:19 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:20 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:21 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:22 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:23 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:24 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:25 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:26 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:27 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:28 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:29 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:30 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:31 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:32 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:33 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:34 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:35 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:36 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:37 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Waiting for EOS from decoder 2019-03-26 23:00:38 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Giving up waiting after 31 tries 2019-03-26 23:00:38 - INFO: decoder2: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Resetting decoder state 2019-03-26 23:00:38 - INFO: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Finished waiting for EOS 2019-03-26 23:00:38 - DEBUG: ws4py: Closing message received (1000) '' 2019-03-26 23:00:38 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Websocket closed() called 2019-03-26 23:00:38 - DEBUG: main: 74d5bbfe-bcf5-436c-bb72-a654a596fec5: Websocket closed() finished 2019-03-26 23:00:39 - INFO: main: Opening websocket connection to master server 2019-03-26 23:00:39 - INFO: main: Opened websocket connection to server