EPIC Large group E2EE conferencing - Element Call SFU integration

[fkwp]

trafficstars

This is an epic issue. List of individual issues is below:

To allow large group conferences and to preserve E2EE a Selective Forwarding Unit (SFU) is necessary as the upstream data rate in full-mesh mode does not scale at large. The concept is already part of MSC3401. Besides the scalability enhancement, a SFU also increases the (network connection) reliability of conferences calls.

• Implement SFU part of MSC3401
• Insertable Streams / s-frame encryption
• Opus Encoder (potentially, if we need more control over audio encoding)

[SimonBrandner]

A very rough plan: https://github.com/matrix-org/sfu-to-sfu/issues/14

[cpt1gl0]

Could someone please give the current status of the SFU implementation?