server-sdk-go icon indicating copy to clipboard operation
server-sdk-go copied to clipboard

turnc ERROR Fail to refresh permissions: all retransmissions failed for xxx

Open SijmenHuizenga opened this issue 1 year ago • 7 comments

Our application that uses the livekit go server-sdk is spitting out a tsunami of Fail to refresh permissions: all retransmissions failed for error messages. At some point hundreds of these messages per hour. Note that this application is handling multiple multiple livekit rooms at the same time, each with 1-5 video streams & 2 audio streams.

image

The error seems to originate from the pion turn project, which is used by Pion Webrtc. From what I read in the the code of pion turn, it seems this error happens when the turn server does not respond to the turn createpermission request. Since were not seeing any failed to refresh allocation messages, my guess is that somehow the TURN connection is still alive? It's weird.

I cannot see anything weird in the actual video streams. But I'm worried that these errors are a sign of a leftover connection or something that's not cleaned up properly.

SijmenHuizenga avatar Jan 22 '24 09:01 SijmenHuizenga

This is still an issue. At this time we are seeing this error continuously, about 13000 times per day.

SijmenHuizenga avatar Mar 11 '24 12:03 SijmenHuizenga

sorry we have not had a chance to look into this one. thanks for the heads up.

davidzhao avatar Mar 12 '24 00:03 davidzhao

We are still seeing about 19k of these errors every day.

Could anyone maybe point me into the direction of where to start debugging? I'm happy to add extra logs or do some experimentation. But I have no idea where to even start looking. Guidance would be much appreciated.

SijmenHuizenga avatar Apr 17 '24 16:04 SijmenHuizenga