Use appropriate platform-native toolkits for decoding video

Open DCNick3 opened this issue 1 year ago • 0 comments

We currently support piping media to ffmpeg and gstreamer backends.

ffmpeg will always be a pain to ship, while gstreamer is only reasonably easy to use on linux. Hence, for better user experience, we need to support more video decoding APIs

Linux: gstreamer is fine
Windows: DirectShow (wider support) or Windows Media Foundation (possibly better tooling/API?)
macOS: Video Toolkit or AVFoundation (I think those are just different levels of the same API)
Android: MediaCodec
Web: WebCodecs

Feb 06 '25 18:02 DCNick3