Video Multiplexing example

[segatecm]

Hi all: I want to send some data with video frame synchronous, like camera position... I found some stuff like Multiplex Video Encoder, But I don't know how to do it. So please give me some advice, Thanks.

[karasusan]

Could you explain Multiplex Video Encoder? We are going to develop the Encoded Streams API for sending/receiving metadata with video frame synchronously. https://github.com/Unity-Technologies/com.unity.webrtc/issues/305

[segatecm]

A class name MultiplexEncoderFactory in webrtc c++ source code. It used to send metadata with video frame. I dont know how to use it in C#. So, please Help!

[karasusan]

Is this? https://source.chromium.org/chromium/chromium/src/+/main:third_party/webrtc/media/engine/multiplex_codec_factory.h

[segatecm]

Yes, MultiplexEncoderFactory. How can I use it in Unity?

[karasusan]

@segatecm Currently, we can not use it.

This module looks interesting. I searched about that, but there is not a lot of information. 😅

[segatecm]

Me too. I want to use it.But can not find any sample.

[karasusan]

memo: URS-368

[segatecm]

Thanks. Where can I check the URS-368 progress?

[karasusan]

@segatecm Sorry, this link is for an internal tracking system, so I cannot share that.

[segatecm]

OK. How long will this feathure be released?

[karasusan]

@segatecm It is difficult to add the feature immediately, please watch the ticket. https://github.com/Unity-Technologies/com.unity.webrtc/issues/578

[segatecm]

Thanks!