element-hq
Noise reduction
Your use case
What would you like to do?
Automatically apply noise reduction filters to participants' audio.
Why would you like to do it?
While noise reduction doesn't improve the intelligibility of speech, it can help prevent auditory fatigue.
How would you like to achieve it?
Integrate noise reduction software such as RNNoise or DeepFilterNet into Element Call via WASM.
Have you considered any alternatives?
Relying on the browser's built-in noise reduction, which is usually very subtle if it exists at all.
Additional context
No response
After some investigation, DeepFilterNet is probably not viable for us to use due to its size. The neuron weights are already 8 MB large, and the full binary weighs in at about 20 MB. RNNoise on the other hand is only 200 kB or so at most.
We could potentially offer DeepFilterNet as a higher quality option built into the desktop and mobile clients, just not on web. RNNoise is already pretty decent, so I wouldn't spend any effort on that for now though.
cc @fkwp
https://jitsi.org/blog/enhanced-noise-suppression-in-jitsi-meet/
https://github.com/jitsi/rnnoise-wasm
