webrtc streaming choppy in VR

[tonyfd]

I'm using Quest 3 to replicate the OpenTeleVision project, utilizing WebRTC to transmit the camera feed. As in OpenTeleVision's work, I used WebRTCStereoVideoPlane and set the source to my WebRTC server address.

When I access the Vuer page on port 8012 in the Quest3's browser, after establishing the socket connection, the camera feed displayed on the plane is very smooth before entering VR mode. However, once I enter VR mode, the feed becomes very choppy, with significant latency. What could be the reason for this?

Similarly, when I use the image mode in OpenTeleVision, i.e., not using WebRTCStereoVideoPlane but instead using ImageBackGround to set and transmit images, there is not such a large difference between entering or not entering VR mode, though the overall transmission quality is worse than WebRTC. Therefore, I still prefer to use WebRTC, but it’s strange that it becomes choppy as soon as I enter VR mode.

My Quest3 and the machine running the Vue server are on the same local network. The server machine is connected to the router via a wired connection, while the Quest3 is connected wirelessly.