client-sdk-swift icon indicating copy to clipboard operation
client-sdk-swift copied to clipboard

Published 20 hours ago • verified publisher icon livekit

A way to send custom audio buffer

Open Yabby1997 opened this issue 1 year ago • 3 comments

Is your feature request related to a problem? Please describe. What I need to implement is to send video and audio buffer on my own in a format of CMSampleBuffer. I found out that it is available to send video by using BufferCapturer but it seems there is no way to send audio in a similar manner.

Describe the solution you'd like Can you provide me a way to send audio buffer on my own if available? If not, will you planning to add a similar way to do so?

Describe alternatives you've considered Directly using LiveKitWebRTC rather using LiveKit.

Additional context

Yabby1997 avatar May 27 '24 09:05 Yabby1997

Unfortunately this is not possible at the moment, I want to add support for this.

hiroshihorie avatar Jun 05 '24 16:06 hiroshihorie

Thanks for letting me know. It's sad to hear that it is not currently supported. I hope to see this feature updated soon.

Yabby1997 avatar Jun 10 '24 05:06 Yabby1997

I think I will need to re-write the WebRTC's AudioDeviceModule using AVAudioEngine and also provide a path to feed in custom buffers. Which will work for screen share also.

hiroshihorie avatar Jul 01 '24 17:07 hiroshihorie