jitsi-videobridge
jitsi-videobridge copied to clipboard
jitsi
h264 simulcast support
Is there any plans to implement simulcast support for H264 ? It's already in chrome from 73.0.3664.3
I'd argue that focusing on VP9 support (VP8 and H264 are broadly similar, VP9 and H265 are similar) would be more useful - VP9 supports SVC, which is quite a bit more useful in that it doesn't require sending multiple simultaneous streams. It can send one stream that is then split for forwarding, allowing you to use your full bandwidth for a high quality feed.
h264 encoding is supported in hardware of mobile phones, so using h264 is important too. without simulcast we have a lot of traffic, so simulcast + 264 is best variant for mobiles.
Just my two cents, but I agree with @alexantropoff
I've done extensive testing enabling/disabling h264 and/or vp8 in my self-hosted install running latest unstable packages and VP8 is a killer for iOS and OSX devices. The CPU immediately goes to 100% and the fans start spinning on the macbooks like a plane is about to take off, and the battery drains so fast having a meeting last longer than 1 hour is almost impossible on a macbook on battery. The lack of any hardware support for encoding/decoding VP8/9 really kills the user experience.
So while I'm a big fan of VP9 and can't wait for it to be supported in Jitsi, I think that h264 support with simulcast in jitsi would really help the user experience too, specially when talking to Apple devices.
Ideally Apple would add hardware encoding/decoding of VP8 and VP9 but don't know how realistic that really is. I've heard that the chips Apple uses (intel I believe) have builtin support for HW enc/decode of VP8 and VP9 but Apple chooses to hide that functionality and only support h264 and h265 (HEVC). If true this is really sad and shows how patents actually stifle innovation and human progress.
@Darcos, intel has indicated that HW encoding and decoding on intel HW has been stripped from drivers. So while the hardware can, it is not available to the VideoToolbox. Hardly Apple fault.
Safari just added support for VP9 in safari tech preview 110, so it's coming, give them time. https://medium.com/@voluntas/safari-techonlogy-preview-110- がvp9-に対応しました-8b62c36cda31
likely, everyone will bootstrap to AV1 as quickly as possible, so I don't know, beyond the technical curiosity, spending time on making VP8 or VP9 work is worth it or not.
@Syonyk H264 annex G defines an SVC mode, but almost no hardware encoder implemented them, making them useless in practice. Same problem for H265 and VP9 which all add optional SVC modes. AV1 is trying to address this problem by making SVC a feature of the base codec, and having the hardware vendor work with it from day 0. However, a lot of the hardware vendors have taken shortcuts so far, since SVC is not used for streaming, which represents their main use case. The jury is still out ;-)
On Fri, May 1, 2020 at 7:17 PM Darcos [email protected] wrote:
Just my two cents, but I agree with @alexantropoff https://github.com/alexantropoff
I've done extensive testing enabling/disabling h264 and/or vp8 in my self-hosted install running latest unstable packages and VP8 is a killer for iOS and OSX devices. The CPU immediately goes to 100% and the fans start spinning on the macbooks like a plane is about to take off, and the battery drains so fast having a meeting last longer than 1 hour is almost impossible on a macbook on battery. The lack of any hardware support for encoding/decoding VP8/9 really kills the user experience.
So while I'm a big fan of VP9 and can't wait for it to be supported in Jitsi, I think that h264 support with simulcast in jitsi would really help the user experience too, specially when talking to Apple devices.
Ideally Apple would add hardware encoding/decoding of VP8 and VP9 but don't know how realistic that really is. I've heard that the chips Apple uses (intel I believe) have builtin support for HW enc/decode of VP8 and VP9 but Apple chooses to hide that functionality and only support h264 and h265 (HEVC). If true this is really sad and shows how patents actually stifle innovation and human progress.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/jitsi/jitsi-videobridge/issues/1173#issuecomment-622349131, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACPLHR7NOUGIDFIMFBT3XTRPKVUHANCNFSM4MC75TPA .
-- Alex. Gouaillard, PhD, PhD, MBA
President - CoSMo Software Consulting, Singapore
sg.linkedin.com/agouaillard
We are successfully using H264 and we can see improvements vs VP8 specially in mobile devices like iOS. We would like to use it with simulcast. Is it a big change for jitsi-videobridge? Can we help somehow?
