AzuraCast icon indicating copy to clipboard operation
AzuraCast copied to clipboard

Published 20 hours ago • verified publisher icon AzuraCast

'Station offline' despite streams working correctly

Open ivellios1988 opened this issue 1 year ago • 18 comments

Installation Method

Docker Installation

AzuraCast Release Channel

Stable Channel

Current AzuraCast Version

0.17.7

What happened?

First of all, I'd like to apologize for my 'the issue is still here in 2023 ;-)' comment, posting such a reply, especially without logs or any additional data was nowhere near a good idea :(

My problem is that recently, from time to time, there is a situation when my installation of AzuraCast shows 'station offline' and 0 listeners despite audio streams working as expected. I can connect to streams, audio works, etc. Just the metadata and listener statistics part is 'dead'.

Since I feel this information may be important, I have two VPS servers running AzuraCast, the 'original' one which DJs connect to, and the 'relay' one. The 'relay' one is meant to be used by my listeners and it also contains a station that creates a broadcast for YouTube. The 'original' server is configured in such a way that it not only generates audio streams that are relayed by the other server but it also sends audio (encoded in AAC with high bitrate to preserve good audio quality) to the 'YouTube' station on the other VPS.

I have checked Liquidsoap logs on my 'original' server and this is what I found. The 'station offline' thing persists since 20:08:54. 'Station offline' goes away when I update metadata manually via a PHP script, no matter what I put in the title section it brings back the title of what's currently played by the AutoDJ.

Relevant log output

2023/03/26 18:56:36 [lang:3] API feedback - Response (200): true
[opus @ 0x7f9d803cda00] Could not update timestamps for discarded samples.
2023/03/26 19:00:10 [decoder:2] Decoding "/var/azuracast/stations/radio_paranormalium/media/muzyka/promowane/Sturm/Sturm feat. Fang VonWrathenstein - White Knights.opus" ended: Ffmpeg_decoder.End_of_file.
2023/03/26 19:00:11 [next_song:3] Prepared "/var/azuracast/stations/radio_paranormalium/media/audycje/Facta Incognita/Facta Incognita - Polskie Missing 411 (odc. 1) (20 mar 2023).mp3" (RID 440).
[mp3float @ 0x7f9d80406a80] Could not update timestamps for skipped samples.
2023/03/26 19:00:11 [cue_next_song:3] Cueing in...
2023/03/26 19:00:11 [lang:3] API nextsong - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/nextsong' with body: 
2023/03/26 19:00:11 [cross_0:3] Analysis: -31.347324dB / -9.434517dB (2.96s / 2.96s)
2023/03/26 19:00:11 [lang:3] API nextsong - Response (200): annotate:title="jingle blogi",artist="Radio Paranormalium",duration="20.00",song_id="86051cb081da10fc8d063ae9abdcac89",media_id="4041",liq_amplify="0.00dB",liq_cross_duration="3.00",liq_fade_in="2.00",liq_fade_out="2.00",playlist_id="4",jingle_mode="true":media:jingle/jingle blogi.mp3
2023/03/26 19:00:11 [lang:3] API feedback - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/feedback' with body: {
2023/03/26 19:00:11 [lang:3]   "song_id": "3644781bd844ff5ad5cf5ce4c42b0ffd",
2023/03/26 19:00:11 [lang:3]   "playlist_id": "7",
2023/03/26 19:00:11 [lang:3]   "media_id": "8029"
2023/03/26 19:00:11 [lang:3] }
[mp3 @ 0x7f9d7c11da80] Estimating duration from bitrate, this may be inaccurate
[mp3 @ 0x7f9d7c00dd00] Estimating duration from bitrate, this may be inaccurate
2023/03/26 19:00:11 [lang:3] API feedback - Response (200): true
2023/03/26 20:08:53 [lang:3] API auth - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/auth' with body: { "password": "MGLNDD_51.195.107.159_8006", "user": "source" }
2023/03/26 20:08:54 [lang:3] API auth - Response (200): false
[mp3float @ 0x7f9d80406a80] Could not update timestamps for discarded samples.
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
[mp3float @ 0x7f9d80406a80] Header missing
2023/03/26 20:35:04 [decoder:2] Decoding "/var/azuracast/stations/radio_paranormalium/media/audycje/Facta Incognita/Facta Incognita - Polskie Missing 411 (odc. 1) (20 mar 2023).mp3" ended: Ffmpeg_decoder.End_of_file.
[mp3 @ 0x7f9d80458a80] Estimating duration from bitrate, this may be inaccurate
[mp3 @ 0x7f9d80458a80] Estimating duration from bitrate, this may be inaccurate
2023/03/26 20:35:04 [next_song:3] Prepared "/var/azuracast/stations/radio_paranormalium/media/jingle/jingle blogi.mp3" (RID 441).
2023/03/26 20:35:04 [cue_next_song:3] Cueing in...
2023/03/26 20:35:04 [lang:3] API nextsong - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/nextsong' with body: 
2023/03/26 20:35:04 [cross_0:3] Analysis: -32.787561dB / -14.325346dB (2.96s / 2.96s)
2023/03/26 20:35:04 [lang:3] API nextsong - Response (200): annotate:title="Po Co Nam Czas",artist="Gabriel Brzask",duration="252.00",song_id="824dcc756572741330354f326803b743",media_id="6366",liq_amplify="0.00dB",liq_cross_duration="3.00",liq_fade_in="2.00",liq_fade_out="2.00",playlist_id="38":media:muzyka/promowane/Gabriel Brzask/Ostatni Koniec Swiata/05 Po Co Nam Czas.m4a
2023/03/26 20:35:05 [lang:3] API feedback - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/feedback' with body: {
2023/03/26 20:35:05 [lang:3]   "song_id": "86051cb081da10fc8d063ae9abdcac89",
2023/03/26 20:35:05 [lang:3]   "playlist_id": "4",
2023/03/26 20:35:05 [lang:3]   "media_id": "4041"
2023/03/26 20:35:05 [lang:3] }
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x7f9d7c11da80] stream 0, timescale not set
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x7f9d7c138f80] stream 0, timescale not set
2023/03/26 20:35:05 [lang:3] API feedback - Response (200): true
2023/03/26 20:35:21 [decoder:2] Decoding "/var/azuracast/stations/radio_paranormalium/media/jingle/jingle blogi.mp3" ended: Ffmpeg_decoder.End_of_file.
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x7f9d82260c00] stream 0, timescale not set
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x7f9d82260c00] stream 0, timescale not set
2023/03/26 20:35:21 [next_song:3] Prepared "/var/azuracast/stations/radio_paranormalium/media/muzyka/promowane/Gabriel Brzask/Ostatni Koniec Swiata/05 Po Co Nam Czas.m4a" (RID 442).
[aac @ 0x7f9d800ebcc0] Could not update timestamps for skipped samples.
2023/03/26 20:35:21 [cue_next_song:3] Cueing in...
2023/03/26 20:35:21 [lang:3] API nextsong - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/nextsong' with body: 
2023/03/26 20:35:21 [lang:3] API nextsong - Response (200): annotate:title="The Soft and Rising Dawn (na licencji CC)",artist="Paul Lisak & After The Ice",duration="251.00",song_id="f284307d0e9cbeefbd43a7d65e526e1c",media_id="7371",liq_amplify="0.00dB",liq_cross_duration="3.00",liq_fade_in="2.00",liq_fade_out="2.00",playlist_id="3":media:muzyka/rock [CC]/Paul Lisak & After The Ice/Commence/03-744852-Paul Lisak _ After The Ice-The Soft and Rising Dawn.mp3
2023/03/26 20:35:22 [cross_0:3] Analysis: -35.453205dB / -91.179176dB (2.96s / 2.96s)
2023/03/26 20:35:22 [lang:3] API feedback - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/feedback' with body: {
2023/03/26 20:35:22 [lang:3]   "song_id": "824dcc756572741330354f326803b743",
2023/03/26 20:35:22 [lang:3]   "playlist_id": "38",
2023/03/26 20:35:22 [lang:3]   "media_id": "6366"
2023/03/26 20:35:22 [lang:3] }
2023/03/26 20:35:22 [lang:3] API feedback - Response (200): true
2023/03/26 20:39:30 [decoder:2] Decoding "/var/azuracast/stations/radio_paranormalium/media/muzyka/promowane/Gabriel Brzask/Ostatni Koniec Swiata/05 Po Co Nam Czas.m4a" ended: Ffmpeg_decoder.End_of_file.
2023/03/26 20:39:30 [next_song:3] Prepared "/var/azuracast/stations/radio_paranormalium/media/muzyka/rock [CC]/Paul Lisak & After The Ice/Commence/03-744852-Paul Lisak _ After The Ice-The Soft and Rising Dawn.mp3" (RID 443).
[mp3float @ 0x7f9d801bcb00] Could not update timestamps for skipped samples.
2023/03/26 20:39:30 [cue_next_song:3] Cueing in...
2023/03/26 20:39:30 [lang:3] API nextsong - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/nextsong' with body: 
2023/03/26 20:39:31 [cross_0:3] Analysis: -99.571960dB / -25.394014dB (2.96s / 2.96s)
2023/03/26 20:39:31 [lang:3] API nextsong - Response (200): annotate:title="124 - Garsc przemyslen po burzliwej dyskusji",artist="Swiat oczami duszy. Audycja o swiadomosci",duration="9000.00",song_id="bc64ec7f3db5247a07ffd937d718f96e",media_id="4574",liq_amplify="0.00dB",liq_cross_duration="3.00",liq_fade_in="2.00",liq_fade_out="2.00",playlist_id="2":media:audycje/Swiat oczami duszy/Swiat oczami duszy. Audycja o swiadomosci - 124 - Garsc przemyslen po burzliwej dyskusji.mp3
2023/03/26 20:39:31 [lang:3] API feedback - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/feedback' with body: {
2023/03/26 20:39:31 [lang:3]   "song_id": "f284307d0e9cbeefbd43a7d65e526e1c",
2023/03/26 20:39:31 [lang:3]   "playlist_id": "3",
2023/03/26 20:39:31 [lang:3]   "media_id": "7371"
2023/03/26 20:39:31 [lang:3] }
2023/03/26 20:39:32 [lang:3] API feedback - Response (200): true
2023/03/26 20:39:32 [clock.main:2] We must catchup 1.33 seconds!
[mp3float @ 0x7f9d801bcb00] Could not update timestamps for discarded samples.
2023/03/26 20:43:38 [decoder:2] Decoding "/var/azuracast/stations/radio_paranormalium/media/muzyka/rock [CC]/Paul Lisak & After The Ice/Commence/03-744852-Paul Lisak _ After The Ice-The Soft and Rising Dawn.mp3" ended: Ffmpeg_decoder.End_of_file.
2023/03/26 20:43:39 [next_song:3] Prepared "/var/azuracast/stations/radio_paranormalium/media/audycje/Swiat oczami duszy/Swiat oczami duszy. Audycja o swiadomosci - 124 - Garsc przemyslen po burzliwej dyskusji.mp3" (RID 444).
[mp3float @ 0x7f9d803cda00] Could not update timestamps for skipped samples.
2023/03/26 20:43:39 [cue_next_song:3] Cueing in...
2023/03/26 20:43:39 [lang:3] API nextsong - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/nextsong' with body: 
2023/03/26 20:43:39 [lang:3] API nextsong - Response (200): annotate:title="UFO-relacje jingle compr",artist="Radio Paranormalium",duration="28.00",song_id="7c20eea999d3518f9cdb4e6b59f30fd6",media_id="4033",liq_amplify="0.00dB",liq_cross_duration="3.00",liq_fade_in="2.00",liq_fade_out="2.00",playlist_id="4",jingle_mode="true":media:jingle/UFO-relacje jingle compr.flac
2023/03/26 20:43:40 [cross_0:3] Analysis: -84.010663dB / -29.315835dB (2.96s / 2.96s)
2023/03/26 20:43:40 [lang:3] API feedback - Sending POST request to 'http://127.0.0.1:6010/api/internal/1/liquidsoap/feedback' with body: {
2023/03/26 20:43:40 [lang:3]   "song_id": "bc64ec7f3db5247a07ffd937d718f96e",
2023/03/26 20:43:40 [lang:3]   "playlist_id": "2",
2023/03/26 20:43:40 [lang:3]   "media_id": "4574"
2023/03/26 20:43:40 [lang:3] }
2023/03/26 20:43:40 [lang:3] API feedback - Response (200): true
2023/03/26 20:43:40 [clock.main:2] We must catchup 1.04 seconds!
2023/03/26 21:46:33 [clock.main:2] We must catchup 7.45 seconds!
2023/03/26 21:46:39 [clock.main:2] We must catchup 12.25 seconds!
2023/03/26 21:46:40 [clock.main:2] We must catchup 13.02 seconds!
2023/03/26 21:46:41 [local_8:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 21:46:41 [local_8:3] Closing connection...
2023/03/26 21:46:41 [local_8:3] Will try to reconnect in 3.00 seconds.
2023/03/26 21:46:43 [clock.main:2] We must catchup 11.82 seconds!
2023/03/26 21:46:45 [clock.main:2] We must catchup 13.74 seconds!
2023/03/26 21:46:45 [local_8:3] Connecting mount /opus8 for [email protected]...
2023/03/26 21:46:45 [local_8:3] Connection setup was successful.
2023/03/26 21:46:46 [clock.main:2] We must catchup 11.99 seconds!
2023/03/26 21:46:47 [clock.main:2] We must catchup 9.84 seconds!
2023/03/26 21:46:48 [clock.main:2] We must catchup 6.64 seconds (we've been late for 100 rounds)!
2023/03/26 21:46:49 [clock.main:2] We must catchup 3.57 seconds (we've been late for 100 rounds)!
2023/03/26 21:46:50 [clock.main:2] We must catchup 0.60 seconds!
2023/03/26 21:54:34 [clock.main:2] We must catchup 3.50 seconds!
2023/03/26 21:54:35 [clock.main:2] We must catchup 0.54 seconds!
2023/03/26 21:56:39 [clock.main:2] We must catchup 5.22 seconds!
2023/03/26 21:56:54 [clock.main:2] We must catchup 20.13 seconds!
2023/03/26 21:56:54 [local_7:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 21:56:54 [local_7:3] Closing connection...
2023/03/26 21:56:54 [local_7:3] Will try to reconnect in 3.00 seconds.
2023/03/26 21:56:54 [local_4:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 21:56:54 [local_4:3] Closing connection...
2023/03/26 21:56:54 [local_4:3] Will try to reconnect in 3.00 seconds.
2023/03/26 21:56:54 [local_2:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 21:56:54 [local_2:3] Closing connection...
2023/03/26 21:56:54 [local_2:3] Will try to reconnect in 3.00 seconds.
2023/03/26 21:56:54 [local_1:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 21:56:54 [local_1:3] Closing connection...
2023/03/26 21:56:54 [local_1:3] Will try to reconnect in 3.00 seconds.
2023/03/26 21:56:54 [local_3:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 21:56:54 [local_3:3] Closing connection...
2023/03/26 21:56:54 [local_3:3] Will try to reconnect in 3.00 seconds.
2023/03/26 21:56:54 [local_5:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 21:56:54 [local_5:3] Closing connection...
2023/03/26 21:56:54 [local_5:3] Will try to reconnect in 3.00 seconds.
2023/03/26 21:56:54 [local_8:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 21:56:54 [local_8:3] Closing connection...
2023/03/26 21:56:54 [local_8:3] Will try to reconnect in 3.00 seconds.
2023/03/26 21:56:54 [local_6:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 21:56:54 [local_6:3] Closing connection...
2023/03/26 21:56:54 [local_6:3] Will try to reconnect in 3.00 seconds.
2023/03/26 21:56:56 [clock.main:2] We must catchup 21.19 seconds!
2023/03/26 21:56:57 [clock.main:2] We must catchup 10.59 seconds (we've been late for 100 rounds)!
2023/03/26 21:56:58 [local_8:3] Connecting mount /opus8 for [email protected]...
2023/03/26 21:56:58 [local_8:3] Connection setup was successful.
2023/03/26 21:56:58 [local_7:3] Connecting mount /6 for [email protected]...
2023/03/26 21:56:58 [local_7:3] Connection setup was successful.
2023/03/26 21:56:58 [local_6:3] Connecting mount /opus24 for [email protected]...
2023/03/26 21:56:58 [local_6:3] Connection setup was successful.
2023/03/26 21:56:58 [local_5:3] Connecting mount /5 for [email protected]...
2023/03/26 21:56:58 [local_5:3] Connection setup was successful.
2023/03/26 21:56:58 [local_4:3] Connecting mount /mp3_48 for [email protected]...
2023/03/26 21:56:59 [local_4:3] Connection setup was successful.
2023/03/26 21:56:59 [local_3:3] Connecting mount /opusHQ for [email protected]...
2023/03/26 21:56:59 [local_3:3] Connection setup was successful.
2023/03/26 21:56:59 [local_2:3] Connecting mount /2 for [email protected]...
2023/03/26 21:56:59 [local_2:3] Connection setup was successful.
2023/03/26 21:56:59 [local_1:3] Connecting mount /1 for [email protected]...
2023/03/26 21:56:59 [local_1:3] Connection setup was successful.
2023/03/26 21:56:59 [clock.main:2] We must catchup 4.21 seconds (we've been late for 100 rounds)!
2023/03/26 21:57:00 [clock.main:2] We must catchup 3.96 seconds!
2023/03/26 21:57:01 [clock.main:2] We must catchup 3.53 seconds!
2023/03/26 21:57:02 [clock.main:2] We must catchup 2.57 seconds!
2023/03/26 21:57:03 [clock.main:2] We must catchup 1.66 seconds!
2023/03/26 21:57:16 [clock.main:2] We must catchup 3.15 seconds!
2023/03/26 21:57:17 [clock.main:2] We must catchup 3.91 seconds!
2023/03/26 21:57:20 [clock.main:2] We must catchup 3.96 seconds!
2023/03/26 21:57:21 [clock.main:2] We must catchup 3.57 seconds!
2023/03/26 21:57:22 [clock.main:2] We must catchup 3.53 seconds!
2023/03/26 21:57:23 [clock.main:2] We must catchup 1.59 seconds!
2023/03/26 22:02:05 [local_2:2] Error while sending data: could not write data to host: connection timeout!
2023/03/26 22:02:05 [local_2:3] Closing connection...
2023/03/26 22:02:05 [local_2:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:02:05 [clock.main:2] We must catchup 30.00 seconds!
2023/03/26 22:02:05 [local_7:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:02:05 [local_7:3] Closing connection...
2023/03/26 22:02:05 [local_7:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:02:05 [local_4:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:02:05 [local_4:3] Closing connection...
2023/03/26 22:02:05 [local_4:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:02:05 [local_3:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:02:05 [local_3:3] Closing connection...
2023/03/26 22:02:05 [local_3:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:02:05 [local_1:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:02:05 [local_1:3] Closing connection...
2023/03/26 22:02:05 [local_1:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:02:05 [local_2:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:02:05 [local_2:3] Closing connection...
2023/03/26 22:02:05 [local_2:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:02:05 [local_5:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:02:05 [local_5:3] Closing connection...
2023/03/26 22:02:05 [local_5:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:02:05 [local_6:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:02:05 [local_6:3] Closing connection...
2023/03/26 22:02:05 [local_6:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:02:05 [local_8:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:02:05 [local_8:3] Closing connection...
2023/03/26 22:02:05 [local_8:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:02:06 [clock.main:2] We must catchup 8.80 seconds (we've been late for 100 rounds)!
2023/03/26 22:02:09 [local_1:3] Connecting mount /1 for [email protected]...
2023/03/26 22:02:09 [local_1:3] Connection setup was successful.
2023/03/26 22:02:09 [local_2:3] Connecting mount /2 for [email protected]...
2023/03/26 22:02:09 [local_2:3] Connection setup was successful.
2023/03/26 22:02:09 [local_3:3] Connecting mount /opusHQ for [email protected]...
2023/03/26 22:02:09 [local_3:3] Connection setup was successful.
2023/03/26 22:02:09 [local_4:3] Connecting mount /mp3_48 for [email protected]...
2023/03/26 22:02:09 [local_4:3] Connection setup was successful.
2023/03/26 22:02:09 [local_5:3] Connecting mount /5 for [email protected]...
2023/03/26 22:02:10 [local_5:3] Connection setup was successful.
2023/03/26 22:02:10 [local_6:3] Connecting mount /opus24 for [email protected]...
2023/03/26 22:02:10 [local_6:3] Connection setup was successful.
2023/03/26 22:02:10 [local_7:3] Connecting mount /6 for [email protected]...
2023/03/26 22:02:10 [local_7:3] Connection setup was successful.
2023/03/26 22:02:10 [local_8:3] Connecting mount /opus8 for [email protected]...
2023/03/26 22:02:10 [local_8:3] Connection setup was successful.
2023/03/26 22:02:10 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:02:16 [local_2:2] Connection failed: 401, Unauthorized (HTTP/1.0)
2023/03/26 22:02:16 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:02:16 [clock.main:2] We must catchup 7.70 seconds!
2023/03/26 22:02:17 [clock.main:2] We must catchup 5.70 seconds!
2023/03/26 22:02:18 [clock.main:2] We must catchup 1.79 seconds (we've been late for 100 rounds)!
2023/03/26 22:02:20 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:02:26 [local_2:2] Connection failed: 401, Unauthorized (HTTP/1.0)
2023/03/26 22:02:26 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:02:26 [clock.main:2] We must catchup 6.69 seconds!
2023/03/26 22:02:27 [clock.main:2] We must catchup 3.25 seconds (we've been late for 100 rounds)!
2023/03/26 22:02:30 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:02:38 [local_2:2] Connection failed: 401, Unauthorized (HTTP/1.0)
2023/03/26 22:02:38 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:02:38 [clock.main:2] We must catchup 8.14 seconds!
2023/03/26 22:02:39 [clock.main:2] We must catchup 4.67 seconds (we've been late for 100 rounds)!
2023/03/26 22:02:40 [clock.main:2] We must catchup 0.87 seconds (we've been late for 100 rounds)!
2023/03/26 22:02:42 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:03:02 [local_2:2] Connection failed: 401, Unauthorized (HTTP/1.0)
2023/03/26 22:03:02 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:03:02 [local_7:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:02 [local_7:3] Closing connection...
2023/03/26 22:03:02 [local_7:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:02 [local_4:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:02 [local_4:3] Closing connection...
2023/03/26 22:03:02 [local_4:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:02 [local_2:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:02 [local_2:3] Closing connection...
2023/03/26 22:03:02 [local_2:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:02 [local_1:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:02 [local_1:3] Closing connection...
2023/03/26 22:03:02 [local_1:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:02 [clock.main:2] We must catchup 20.39 seconds!
2023/03/26 22:03:02 [local_5:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:02 [local_5:3] Closing connection...
2023/03/26 22:03:02 [local_5:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:02 [local_3:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:02 [local_3:3] Closing connection...
2023/03/26 22:03:02 [local_3:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:02 [local_6:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:03 [local_6:3] Closing connection...
2023/03/26 22:03:03 [local_6:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:03 [local_8:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:03 [local_8:3] Closing connection...
2023/03/26 22:03:03 [local_8:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:03 [clock.main:2] We must catchup 14.43 seconds (we've been late for 100 rounds)!
2023/03/26 22:03:04 [clock.main:2] We must catchup 1.04 seconds (we've been late for 100 rounds)!
2023/03/26 22:03:06 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:03:20 [local_2:2] Connection failed: 401, Unauthorized (HTTP/1.0)
2023/03/26 22:03:20 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:03:20 [local_8:3] Connecting mount /opus8 for [email protected]...
2023/03/26 22:03:20 [local_8:3] Connection setup was successful.
2023/03/26 22:03:20 [local_7:3] Connecting mount /6 for [email protected]...
2023/03/26 22:03:21 [local_7:3] Connection setup was successful.
2023/03/26 22:03:21 [local_6:3] Connecting mount /opus24 for [email protected]...
2023/03/26 22:03:21 [local_6:3] Connection setup was successful.
2023/03/26 22:03:21 [local_5:3] Connecting mount /5 for [email protected]...
2023/03/26 22:03:21 [local_5:3] Connection setup was successful.
2023/03/26 22:03:21 [local_4:3] Connecting mount /mp3_48 for [email protected]...
2023/03/26 22:03:21 [local_4:3] Connection setup was successful.
2023/03/26 22:03:21 [local_3:3] Connecting mount /opusHQ for [email protected]...
2023/03/26 22:03:21 [local_3:3] Connection setup was successful.
2023/03/26 22:03:21 [local_2:3] Connecting mount /2 for [email protected]...
2023/03/26 22:03:22 [local_2:3] Connection setup was successful.
2023/03/26 22:03:22 [local_1:3] Connecting mount /1 for [email protected]...
2023/03/26 22:03:22 [local_1:3] Connection setup was successful.
2023/03/26 22:03:22 [clock.main:2] We must catchup 16.35 seconds!
2023/03/26 22:03:23 [clock.main:2] We must catchup 14.23 seconds!
2023/03/26 22:03:24 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:03:54 [local_2:2] Connection failed: Cry__Cry_common.Timeout
2023/03/26 22:03:54 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:03:54 [clock.main:2] We must catchup 42.86 seconds!
2023/03/26 22:03:54 [local_7:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:54 [local_7:3] Closing connection...
2023/03/26 22:03:54 [local_7:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:54 [local_4:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:54 [local_4:3] Closing connection...
2023/03/26 22:03:54 [local_4:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:54 [local_1:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:54 [local_1:3] Closing connection...
2023/03/26 22:03:54 [local_1:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:54 [local_2:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:54 [local_2:3] Closing connection...
2023/03/26 22:03:54 [local_2:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:54 [local_5:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:54 [local_5:3] Closing connection...
2023/03/26 22:03:54 [local_5:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:54 [local_3:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:54 [local_3:3] Closing connection...
2023/03/26 22:03:54 [local_3:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:54 [local_6:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:54 [local_6:3] Closing connection...
2023/03/26 22:03:54 [local_6:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:54 [local_8:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:03:54 [local_8:3] Closing connection...
2023/03/26 22:03:54 [local_8:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:03:55 [clock.main:2] We must catchup 19.50 seconds (we've been late for 100 rounds)!
2023/03/26 22:03:58 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:04:13 [local_2:2] Connection failed: 401, Unauthorized (HTTP/1.0)
2023/03/26 22:04:13 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:04:13 [local_8:3] Connecting mount /opus8 for [email protected]...
2023/03/26 22:04:13 [local_8:3] Connection setup was successful.
2023/03/26 22:04:13 [local_7:3] Connecting mount /6 for [email protected]...
2023/03/26 22:04:14 [local_7:3] Connection setup was successful.
2023/03/26 22:04:14 [local_6:3] Connecting mount /opus24 for [email protected]...
2023/03/26 22:04:14 [local_6:3] Connection setup was successful.
2023/03/26 22:04:14 [local_5:3] Connecting mount /5 for [email protected]...
2023/03/26 22:04:14 [local_5:3] Connection setup was successful.
2023/03/26 22:04:14 [local_4:3] Connecting mount /mp3_48 for [email protected]...
2023/03/26 22:04:14 [local_4:3] Connection setup was successful.
2023/03/26 22:04:14 [local_3:3] Connecting mount /opusHQ for [email protected]...
2023/03/26 22:04:14 [local_3:3] Connection setup was successful.
2023/03/26 22:04:14 [local_2:3] Connecting mount /2 for [email protected]...
2023/03/26 22:04:15 [local_2:3] Connection setup was successful.
2023/03/26 22:04:15 [local_1:3] Connecting mount /1 for [email protected]...
2023/03/26 22:04:15 [local_1:3] Connection setup was successful.
2023/03/26 22:04:15 [clock.main:2] We must catchup 17.38 seconds!
2023/03/26 22:04:16 [clock.main:2] We must catchup 15.18 seconds!
2023/03/26 22:04:17 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:04:47 [local_2:2] Connection failed: Cry__Cry_common.Timeout
2023/03/26 22:04:47 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:04:47 [clock.main:2] We must catchup 43.09 seconds!
2023/03/26 22:04:47 [local_2:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:04:47 [local_2:3] Closing connection...
2023/03/26 22:04:47 [local_2:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:04:47 [local_1:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:04:47 [local_1:3] Closing connection...
2023/03/26 22:04:47 [local_1:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:04:47 [local_4:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:04:47 [local_4:3] Closing connection...
2023/03/26 22:04:47 [local_4:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:04:47 [local_5:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:04:47 [local_5:3] Closing connection...
2023/03/26 22:04:47 [local_5:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:04:47 [local_7:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:04:47 [local_7:3] Closing connection...
2023/03/26 22:04:47 [local_7:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:04:47 [local_3:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:04:47 [local_3:3] Closing connection...
2023/03/26 22:04:47 [local_3:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:04:47 [local_6:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:04:47 [local_6:3] Closing connection...
2023/03/26 22:04:47 [local_6:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:04:47 [local_8:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:04:47 [local_8:3] Closing connection...
2023/03/26 22:04:47 [local_8:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:04:48 [clock.main:2] We must catchup 23.65 seconds (we've been late for 100 rounds)!
2023/03/26 22:04:51 [local_1:3] Connecting mount /1 for [email protected]...
2023/03/26 22:04:51 [local_1:3] Connection setup was successful.
2023/03/26 22:04:51 [local_2:3] Connecting mount /2 for [email protected]...
2023/03/26 22:04:51 [local_2:3] Connection setup was successful.
2023/03/26 22:04:51 [local_3:3] Connecting mount /opusHQ for [email protected]...
2023/03/26 22:04:51 [local_3:3] Connection setup was successful.
2023/03/26 22:04:51 [local_4:3] Connecting mount /mp3_48 for [email protected]...
2023/03/26 22:04:51 [local_4:3] Connection setup was successful.
2023/03/26 22:04:51 [local_5:3] Connecting mount /5 for [email protected]...
2023/03/26 22:04:52 [local_5:3] Connection setup was successful.
2023/03/26 22:04:52 [local_6:3] Connecting mount /opus24 for [email protected]...
2023/03/26 22:04:52 [local_6:3] Connection setup was successful.
2023/03/26 22:04:52 [local_7:3] Connecting mount /6 for [email protected]...
2023/03/26 22:04:52 [local_7:3] Connection setup was successful.
2023/03/26 22:04:52 [local_8:3] Connecting mount /opus8 for [email protected]...
2023/03/26 22:04:52 [local_8:3] Connection setup was successful.
2023/03/26 22:04:52 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:05:22 [local_2:2] Connection failed: Cry__Cry_common.Timeout
2023/03/26 22:05:22 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:05:22 [clock.main:2] We must catchup 31.90 seconds!
2023/03/26 22:05:22 [local_8:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:05:22 [local_8:3] Closing connection...
2023/03/26 22:05:22 [local_8:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:05:22 [local_6:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:05:22 [local_6:3] Closing connection...
2023/03/26 22:05:22 [local_6:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:05:23 [local_3:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:05:23 [local_3:3] Closing connection...
2023/03/26 22:05:23 [local_3:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:05:23 [local_1:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:05:23 [local_1:3] Closing connection...
2023/03/26 22:05:23 [local_1:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:05:23 [local_2:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:05:23 [local_2:3] Closing connection...
2023/03/26 22:05:23 [local_2:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:05:23 [local_4:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:05:23 [local_4:3] Closing connection...
2023/03/26 22:05:23 [local_4:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:05:23 [local_7:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:05:23 [local_7:3] Closing connection...
2023/03/26 22:05:23 [local_7:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:05:23 [local_5:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:05:23 [local_5:3] Closing connection...
2023/03/26 22:05:23 [local_5:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:05:23 [clock.main:2] We must catchup 15.34 seconds (we've been late for 100 rounds)!
2023/03/26 22:05:26 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:05:56 [local_2:2] Connection failed: Cry__Cry_common.Timeout
2023/03/26 22:05:56 [local_2:3] Will try again in 3.00 sec.
2023/03/26 22:05:56 [local_8:3] Connecting mount /opus8 for [email protected]...
2023/03/26 22:05:56 [local_8:3] Connection setup was successful.
2023/03/26 22:05:56 [local_7:3] Connecting mount /6 for [email protected]...
2023/03/26 22:05:56 [local_7:3] Connection setup was successful.
2023/03/26 22:05:56 [local_6:3] Connecting mount /opus24 for [email protected]...
2023/03/26 22:05:56 [local_6:3] Connection setup was successful.
2023/03/26 22:05:56 [local_5:3] Connecting mount /5 for [email protected]...
2023/03/26 22:05:57 [local_5:3] Connection setup was successful.
2023/03/26 22:05:57 [local_4:3] Connecting mount /mp3_48 for [email protected]...
2023/03/26 22:05:57 [local_4:3] Connection setup was successful.
2023/03/26 22:05:57 [local_3:3] Connecting mount /opusHQ for [email protected]...
2023/03/26 22:05:57 [local_3:3] Connection setup was successful.
2023/03/26 22:05:57 [local_2:3] Connecting mount /2 for [email protected]...
2023/03/26 22:05:57 [local_2:3] Connection setup was successful.
2023/03/26 22:05:57 [local_1:3] Connecting mount /1 for [email protected]...
2023/03/26 22:05:57 [local_1:3] Connection setup was successful.
2023/03/26 22:05:57 [clock.main:2] We must catchup 31.92 seconds!
2023/03/26 22:05:59 [clock.main:2] We must catchup 31.13 seconds!
2023/03/26 22:06:00 [local_2:3] Connecting mount / for [email protected]...
2023/03/26 22:06:16 [local_2:3] Connection setup was successful.
2023/03/26 22:06:16 [clock.main:2] We must catchup 44.98 seconds!
2023/03/26 22:06:16 [local_7:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:06:16 [local_7:3] Closing connection...
2023/03/26 22:06:16 [local_7:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:06:16 [local_4:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:06:16 [local_4:3] Closing connection...
2023/03/26 22:06:16 [local_4:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:06:16 [local_1:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:06:16 [local_1:3] Closing connection...
2023/03/26 22:06:16 [local_1:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:06:16 [local_2:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:06:16 [local_2:3] Closing connection...
2023/03/26 22:06:16 [local_2:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:06:16 [local_5:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:06:16 [local_5:3] Closing connection...
2023/03/26 22:06:16 [local_5:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:06:16 [local_3:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:06:16 [local_3:3] Closing connection...
2023/03/26 22:06:16 [local_3:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:06:16 [local_6:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:06:16 [local_6:3] Closing connection...
2023/03/26 22:06:16 [local_6:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:06:16 [local_8:2] Error while sending data: could not write data to host: Broken pipe in write()!
2023/03/26 22:06:16 [local_8:3] Closing connection...
2023/03/26 22:06:16 [local_8:3] Will try to reconnect in 3.00 seconds.
2023/03/26 22:06:18 [clock.main:2] We must catchup 42.96 seconds (we've been late for 100 rounds)!
2023/03/26 22:06:19 [clock.main:2] We must catchup 30.44 seconds (we've been late for 100 rounds)!
2023/03/26 22:06:20 [local_1:3] Connecting mount /1 for [email protected]...
2023/03/26 22:06:20 [local_1:3] Connection setup was successful.
2023/03/26 22:06:20 [local_2:3] Connecting mount /2 for [email protected]...
2023/03/26 22:06:20 [local_2:3] Connection setup was successful.
2023/03/26 22:06:20 [local_3:3] Connecting mount /opusHQ for [email protected]...
2023/03/26 22:06:20 [local_3:3] Connection setup was successful.
2023/03/26 22:06:20 [local_4:3] Connecting mount /mp3_48 for [email protected]...
2023/03/26 22:06:20 [local_4:3] Connection setup was successful.
2023/03/26 22:06:20 [local_5:3] Connecting mount /5 for [email protected]...
2023/03/26 22:06:21 [local_5:3] Connection setup was successful.
2023/03/26 22:06:21 [local_6:3] Connecting mount /opus24 for [email protected]...
2023/03/26 22:06:21 [local_6:3] Connection setup was successful.
2023/03/26 22:06:21 [local_7:3] Connecting mount /6 for [email protected]...
2023/03/26 22:06:21 [local_7:3] Connection setup was successful.
2023/03/26 22:06:21 [local_8:3] Connecting mount /opus8 for [email protected]...
2023/03/26 22:06:21 [local_8:3] Connection setup was successful.
2023/03/26 22:06:21 [clock.main:2] We must catchup 25.87 seconds (we've been late for 100 rounds)!
2023/03/26 22:06:22 [clock.main:2] We must catchup 24.28 seconds!
2023/03/26 22:06:23 [clock.main:2] We must catchup 21.32 seconds!
2023/03/26 22:06:24 [clock.main:2] We must catchup 18.65 seconds!
2023/03/26 22:06:25 [clock.main:2] We must catchup 16.58 seconds!
2023/03/26 22:06:26 [clock.main:2] We must catchup 13.35 seconds (we've been late for 100 rounds)!
2023/03/26 22:06:27 [clock.main:2] We must catchup 10.20 seconds (we've been late for 100 rounds)!
2023/03/26 22:06:28 [clock.main:2] We must catchup 8.09 seconds!
2023/03/26 22:06:29 [clock.main:2] We must catchup 5.13 seconds!
2023/03/26 22:06:30 [clock.main:2] We must catchup 2.18 seconds!
2023/03/26 22:06:32 [clock.main:2] We must catchup 1.04 seconds!

ivellios1988 avatar Mar 26 '23 20:03 ivellios1988

+1 bump for this, I've been having this issue for the last 3 or so months (I'm on the rolling release tho)

christiansacks avatar Apr 23 '23 14:04 christiansacks

@christiansacks We need more information on what's actually possibly causing this before we can fix it.

My local tests, at least on the current Rolling Release version, all come back working perfectly. I've tested with the latest Icecast, on a station with only the broadcasting frontend and no AutoDJ. Both relayed streams and DJ-connected ones return metadata correctly and don't show as "Station Offline".

It seems like there can be occasional bugs where Icecast ends up with "empty" metadata (i.e. a title and artist string of literally ""), but it's still online. Perhaps we could be a little more resilient in these cases, just persisting whatever the previous metadata we received was in such an event.

BusterNeece avatar Apr 24 '23 14:04 BusterNeece

Side note: Some countries calculate license fees for songs played by a) how often a song is played, or b) how long (duration) the song is played, or maybe even both.

So showing a "wrong" song being played can be problematic, because if one just leaves "the old metadata" in case none is sent, it might corrupt license fee reports. I have this already when a time announcement interrupts a playing song that is then continued, and you have set not to show the jingle’s metadata: The song is listed twice in succession and would be due for a double license fee.

The one problem we really have is when streamer software only sends metadata at stream start (and doesn’t repeat/update) and Liquidsoap doesn’t catch it.

Just to say keeping that in mind might be useful…

Maybe a solution could be to differentiate between "Station really offline" and "No metadata seen" and just show a different text for these cases?

Moonbase59 avatar Apr 24 '23 14:04 Moonbase59

I'm having the same problem, i've narrowed down the trigger being Remote Relays. if you add a Shoutcast V2 Relay and apply changes, the currently playing track will always read "Station Offline" on the Azuracast pages, though the ID3 tags may be sent to the shoutcast relay just fine, and the stream will be playing just fine. This seems limited to Auto DJ, i haven't tested if this affects live streaming too, So it's either a bug in the ID3/Metadata parsing in Liquidsoap, or something breaking the variable with the relay section. I hope this helps narrow things down.

Edit: Though sometimes the title on the target shoutcast relay will be incorrect too after further testing.

ronlaws86 avatar May 20 '23 13:05 ronlaws86

Not sure if it's related, but i also see this relating to the relay when i try for IceCast [2023-05-21T12:45:33.096383+00:00] AzuraCast.ERROR: HTTP client GET call to https://ip_address_redacted:8000/admin/listclients?mount=%2Fstream.mp3 produced response NULL [] {"station":{"id":1,"name":"Station Name"}}

If i visit the URL in a browser though, it seems to be returning valid XML data

ronlaws86 avatar May 21 '23 12:05 ronlaws86

@ronlaws86 What version of Shoutcast is the remote relay? It may be returning a different format than we're expecting, since we haven't updated the relevant code for Shoutcast in a while.

BusterNeece avatar May 21 '23 17:05 BusterNeece

If it helps, I don't use a remote relay and I still get the station offline message even though there's music playing just fine

christiansacks avatar May 22 '23 10:05 christiansacks

@ronlaws86 What version of Shoutcast is the remote relay? It may be returning a different format than we're expecting, since we haven't updated the relevant code for Shoutcast in a while.

@BusterNeece Shoutcast V 2.6.0.753

ronlaws86 avatar May 28 '23 11:05 ronlaws86

I need some instances to test this with. Is anyone able to either give me specific steps to reproduce this on a stock installation or credentials to access your specific installation's remote relay? For this specific issue, feel free to e-mail me at [email protected] if interested.

BusterNeece avatar May 29 '23 06:05 BusterNeece

@BusterNeece I'm using luzifer/shoutcast:latest Docker image for the relay. It does also re-produce if you try to use another instance of Azuracast as a relay. The issue currently exists on the stable and latest branches of Azuracast.

Simply get a copy of Shoutcast or Icecast running, then fill out the information in the relay configuration accordingly and then restart the station once applied and have auto dj active with some tracks. Below is the docker compose you can use:

version: '3.7'
services:
  shoutcast:
    image: 'luzifer/shoutcast:latest'
    ports:
      - '8880:8880'
      - '8881:8881'
    networks:
      vpcbr:
        ipv4_address: 11.0.0.5
    volumes:
      - '/PATH_TO_YOUR/shoutcast.conf:/etc/shoutcast/shoutcast.conf'
networks:
  vpcbr:
    driver: bridge
    ipam:
      config:
        - subnet: 11.0.0.0/16
          gateway: 11.0.0.1

shoutcast.conf

adminpassword=_ _ _ 
maxuser=100
password=_ _ _ 
publicserver=never
requirestreamconfigs=1
streamid_1=1
streamid_2=2
streamid_3=3
streamid_4=4
portbase=8880

ronlaws86 avatar May 31 '23 06:05 ronlaws86

I need some instances to test this with. Is anyone able to either give me specific steps to reproduce this on a stock installation or credentials to access your specific installation's remote relay? For this specific issue, feel free to e-mail me at [email protected] if interested.

I'm facing this same issue on a fresh install.

Debian 11, installed via the ./docker.sh script. Rolling release refuses to start the AutoDJ service, stable is playing, but always showing 'Station offline'. Although the webhook to display now playing songs in Telegram works fine, so the data's there. Just won't display in the player.

I've reinstalled Debian on my server fresh as well. Very strange.

Dos-Boss avatar Jun 06 '23 22:06 Dos-Boss

Any progress with this? It's still happening on the latest rolling release and is very irritating. Sometimes i can make it go away by restarting a few times, other times i seem to roll a nat 1 at life :upside_down_face:

Also noticed that Azuracast can't seem to fetch the listener stats from Shoutcast? just reports zero listeners, which isn't ideal....

[2023-10-13T12:59:30.386532+00:00] AzuraCast.ERROR: Now Playing error: Class "NowPlaying\Enums\AdapterTypes" not found {"exception":"[object] (Error(code: 0): Class \"NowPlaying\\Enums\\AdapterTypes\" not found at /var/azuracast/www/src/Radio/Remote/Shoutcast2.php:13)"} {"station":{"id":2,"name":"Fantasy Radio"}}

ronlaws86 avatar Oct 13 '23 12:10 ronlaws86

image in fact I seem to be able to re-produce this without even trying! it's very bizarre and quite frustrating, especially when it seems to not to want to go away sometimes. I have to remove all traces of any form of shoutcast relay from the webUI config and/or liquid soap and then restart broadcasting and let it run with just built in icecast to allow the stream titles to update correctly. if i start adding Shoutcast relays it completely breaks and stays broken..

I can then get it to function correctly by manually adding in a quid soap config, but of course it isn't listed under the relays or in the public pages anymore and has no listener stats polling (Not that this feature seems to be working anyway) But i must wrangle to get there, Remove all relays, all liquid soap configs. restart. let it run a bit then directly add the liquid soap config and nothing else, then restart again and stream titles will work. But if I try to do it via the WebUI, there's a decent chance it will break.

ronlaws86 avatar Oct 13 '23 13:10 ronlaws86

@ronlaws86 It's possible Shoutcast has changed their API format in recent versions and we're having trouble with that new version. I'll have to look into that. We don't use Shoutcast much in our testing as it's a proprietary (and, in almost every use-case, worse) alternative to Icecast.

BusterNeece avatar Oct 13 '23 15:10 BusterNeece

I don't Disagree honestly. Icecast has a lot more going for it these days. Shoutcast V2 is still pretty powerful for what it does, but being at the mercy at [Insert latest buyer here] is one of the current drawbacks of it. The only major downside is Shoutcast has been around forever, i've even seen some old 32bit v1 stations that have been running for over a decade at this point and some (often older) software only supports Shoutcast :cry:

ronlaws86 avatar Oct 13 '23 15:10 ronlaws86

I'm pushing an update that should avoid several conditions that currently happen where a station is indeed broadcasting (either to a local or a remote) but is still showing as offline.

BusterNeece avatar Oct 14 '23 00:10 BusterNeece

@BusterNeece I am experiencing same issue where station is broadcasting but still showing offline. I am running stable 19.4 and have reloaded and restarted station but still shows offline. I am not sure what to look for in the logs.

dekakast avatar Feb 16 '24 08:02 dekakast

I'm not sure if this is the same issue. But when I was setting my instance of Azuracast up I needed it to work as a relay. Pulling feeds from another public server. I don't use any of the liquidsoap or auto dj functions. I also have 3 different bit rates for each station. So I added 3 mounts and told them to all pull from the appropriate server. I had no luck getting "Station Offline" to dissapear from the embedded player widget..... UNTIL I DISABLED ALL AUTO DJ FUNCTIONS. Boom! Fixed.....

IF I "pushed" to the same mount (in the standard way). The metadata flipped over to the source instead of what auto dj was playing. Just didn't like it when running the mounts as relays. Hope this helps.

StationXX avatar Jun 17 '24 08:06 StationXX