PercepNet icon indicating copy to clipboard operation
PercepNet copied to clipboard

RSS+NS based on PercepNet

Open cloudvc opened this issue 2 years ago • 2 comments

Hi all,

Hope to discuss the RSS+NS based on PercepNet. I want to combine the AEC linear part from webrtc with PercepNet implementation to improve the RSS/NS of webrtc.

cloudvc avatar Sep 02 '22 02:09 cloudvc

Hi, that's interesting thing, I'm happy to extend percepnet, author of PercepNet already implemented it in this papaer https://arxiv.org/pdf/2102.05245.pdf probably you should follow this approach.

the main different between percepnet and aec-combined-percepnet is percepnet => input = noisy , output = clean, aec-combined-percepnet input = (aec-processed-noisy, farend signal) ,output = clean

to do so you should make framework which can generate aec processed noisy signal, from far-end and noisy file also, you need to add another input head to percepnet model

however, on a recent paper MTFAANET, they use aec-processed noisy singal as conditional input and they apply mask to original noisy file to reduce distortion from aec.

jzi040941 avatar Sep 30 '22 02:09 jzi040941

Thanks for your guide. I will follow MTFAANET too.

cloudvc avatar Oct 11 '22 02:10 cloudvc