client-sdk-swift icon indicating copy to clipboard operation
client-sdk-swift copied to clipboard

LocalParticipant - isSpeaking - delay

Open patryk-sredzinski opened this issue 1 year ago • 2 comments

Seems like:

public func participant(_ participant: Participant, didUpdateIsSpeaking isSpeaking: Bool)

is called after a delay, when the audio from our microphone goes to server and it returns this message to us.

Is there any way that I can get isSpeaking and audioLevel properties that are for local audio track and are immediately, so the UI can be more responsive?

patryk-sredzinski avatar Apr 22 '24 13:04 patryk-sredzinski

Hello actually I'm interested in implementing client-side signal processing so we can get more real time "isSpeaking" and audio visualization etc.

This is not a bug but would be an enhancement.

hiroshihorie avatar Apr 22 '24 14:04 hiroshihorie

Hi @hiroshihorie we would also really appreciate this enhancement for our use case! Currently we are installing our own tap to read and publish track information in real time from the microphone, since as mentioned in the issue the delay from the didUpdateIsSpeaking event presents an unresponsive feeling. It would be great to have some client-side signal processing via LiveKit instead!

ShibireX avatar Jul 14 '24 19:07 ShibireX