DeepFilterNet Implement a real-time loop for DeepFilterNet

Hi Hendrik, Just curious as didn't see any benchmarks but could it run chunking audio as it goes or does it need the overall file to analyse? How does it compare to https://github.com/breizhn/DTLN?

Thanks Stuart

May 07 '22 04:05 StuartIanNaylor

Hi Stuart,

thanks for your interest in this project. As of now, no real-time loop is available. There is a WIP version in #13, but it has a bug in the 2nd stage resulting in worse audio quality. So this is definitely planned, but I cannot give an ETA.

May 09 '22 05:05 Rikorose

No probs but great to hear as been wondering how it compares to https://github.com/breizhn/DTLN so if you would if you remember add a comment so that I see it in notifications. Also just out curiosity but is there any method that is purely to extract a single KW (Keyword) from noise as voicefilter-lite is targeted speaker extraction as an example is it possible to do targeted KW extraction? For want of a better description. PS had to look up Tract is that generally more performant than rust tflite or just more interoperable?

May 09 '22 09:05 StuartIanNaylor

Also just out curiosity but is there any method that is purely to extract a single KW (Keyword) from noise as voicefilter-lite is targeted speaker extraction as an example is it possible to do targeted KW extraction?

Keyword detection is a different problem and only barely related to speech enhancement.

PS had to look up Tract is that generally more performant than rust tflite or just more interoperable?

I haven't used rust tf light, so I cannot comment on this. I would be interested in some benchmarks as well.

May 09 '22 10:05 Rikorose

Ideally a real-time loop would be implemented in Rust, so we can ship a compiled binary without any dependencies.

May 13 '22 07:05 Rikorose

Hi Stuart,

thanks for your interest in this project. As of now, no real-time loop is available. There is a WIP version in #13, but it has a bug in the 2nd stage resulting in worse audio quality. So this is definitely planned, but I cannot give an ETA.

is it still the case right now after v0.2.3?

May 26 '22 13:05 isgursoy

Still the case as long as this issue is open.

May 26 '22 13:05 Rikorose

Relevant https://github.com/Rikorose/DeepFilterNet/issues/106

Jun 28 '22 13:06 isgursoy

Simple implementation of a real-time, you can experience https://github.com/andyweiqiu/denoiser-realtime-48k-ios

Sep 07 '22 03:09 andyweiqiu

Thanks for the link. It would be great, if you would contribute back to the open source community and open source the denoising loop as well.

Sep 07 '22 07:09 Rikorose

Hi folks, I released a real time loop fully written in Rust. You can download a deep-filter executable in the latest 0.3.0 release.

Oct 20 '22 17:10 Rikorose