[BUG] VideoStreamInput interferes with CaptureScreenshotIntoRenderTexture

[burakkaraceylan]

I am trying to receive webcam input from the browser and send screen capture from unity. When using the bidirectional example the screen record of unity shows for a couple of seconds but when the webcam media is received from the web browser some corrupted video signal overlays on the screen. This doesn't happen with camera stream captures.

[karasusan]

Could you tell me more information?

• Platform (windows, macOS)
• Browser
• Browser version
• Unity
• Unity version
• Encoder type

[burakkaraceylan]

Sure, sorry about that.

Platform: Windows 11 Browser: Google Chrome Browser Version: 96.0.4664.93 Unity version: 2020.3.21f Encoder type: software

Below is the function that takes the screenshot and sends it over the mediastream.

IEnumerator RecordFrame()
{
    yield return new WaitForEndOfFrame();
    ScreenCapture.CaptureScreenshotIntoRenderTexture(m_sendTexture);
}

[kannan-xiao4]

@burakkaraceylan Thanks your replay. We can't support Windows 11 yet, so the environment may be a problem. As a confirmation, do ours Bidirectional sample and Broadcast sample work in your environment?

[burakkaraceylan]

Hello @kannan-xiao4

Those samples work fine and as I stated, using the webcamstreamsender also works fine in my project. The problem happens when I use the screenstreamsender from the unity and webcam stream from the browser. More specifically the image captured by ScreenCapture.CaptureScreenshotIntoRenderTexture gets broken.

Sometimes the remote webcam image appears overlayed on top of the screen capture, sometimes the image is completely distorted. Looks like some kind of buffer overflow happening.

Could you confirm that bidirectional example works if you use screenstreamsender please?

[kannan-xiao4]

@burakkaraceylan Thank you for the details. We will check behavior. memo:URS-382