janus-ftl-plugin icon indicating copy to clipboard operation
janus-ftl-plugin copied to clipboard

Video improvements for poor network conditions

Open clone1018 opened this issue 3 years ago • 2 comments

We'll be focused on making improvements that help viewers have a reliable experience viewing streams on Glimesh, even in poorer network conditions. One of the main objectives will be supporting the Glimesh Mobile App with the ability to view streams, but the exact implementation is still to be determined.

This is a roadmap epic to capture work involving improving video for poor network conditions.

Examples of potential work:

  • NACKs
  • HLS
  • RTMP
  • etc

This feature is still being groomed and could change frequently.

clone1018 avatar Apr 20 '21 14:04 clone1018

My rough plan of what I'm going to look at:

  • [x] Re-enable NACKs #95 #135
  • [ ] Add playout delay #134 https://github.com/Glimesh/ops/pull/41
    • This should workaround the issues seen in #101
  • [ ] Email webrtc list if playout delay works and work with them to get a real fix in for the issue
  • [ ] Capture additional metrics for debugging and tuning (or eventually removing) the playout delay
  • [ ] ftl-sdk traffic shaping improvements for OBS (or move ingest to RTMP/SRT/WebRTC/etc that have already solved this)

Other things not listed that might also help:

  • [ ] Transcoding
  • [ ] WebRTC in OBS
  • [ ] Scalable video coding in ftl-sdk ( might be possible to send both 720p and 240p video layers, or at least temporal scaling might help with severe packet loss)
  • [ ] Adaptive bitrate in ftl-sdk

danstiner avatar Apr 22 '21 07:04 danstiner

I also would like to look at RTMP and HLS as a means of improving reliability at ingest and edge respectively.

haydenmc avatar Apr 22 '21 20:04 haydenmc