Document: Current status & plans on low latency streaming, webrtc etc.

[shaqq]

Is your feature request related to a problem? Please describe. We have various real-time streams that we need low-latency visibility on. We need a GUI to view the streams, transform the data, replay the streams, and run model inference on them in real-time. We also need to mix/match the ML models to compare the results. These streams are high throughput, like video, audio, IMU, etc.

Describe the solution you'd like A UDP protocol in rerun that accepts high throughput streams like video/audio/imu to log samples. WebRTC is a nice balance of a network protocol that also supports codecs.

Describe alternatives you've considered Building our own solution in WebRTC

I saw #5815 for video codec support, but I wasn't sure to what extent there's broad interest in supporting WebRTC (which is admittedly very challenging).

I know there's TCP streaming, but this isn't quite ideal for us. Low-latency is really important for our use case, and TCP adds enough latency to make it not worth the effort.