PercepNet icon indicating copy to clipboard operation
PercepNet copied to clipboard

Lookahead in compute_rnn (c++)

Open aaronhsueh0506 opened this issue 3 years ago • 3 comments

Hi Noh,

We queue a buffer when I was training the model (maybe 500 frames), but I think the funciton compute_rnn looks like a frame-in-frame-out flow. My question is, is there no need to prepare a buffer for inference?

Thanks, Aaron

aaronhsueh0506 avatar May 10 '22 02:05 aaronhsueh0506

Hi there, rnnoise_process_frame is called while inference step, in that function it calls compute_frame_features function which is stacking input X to comb_buf and pitch_buf.

so there's no need to add buffer in compute_rnn.

I'm not sure this is your intention of your question. feel free to leave comments more if is not correct

jzi040941 avatar May 18 '22 01:05 jzi040941

Hi Noh,

Thanks for your reply. Yes, I am confused about buffer. So we only feed a frame length data into the neural network? Because I am trying to construct the real-time flow and the frame length is a factor related to the complexity of the model.

Thanks, Aaron

aaronhsueh0506 avatar May 19 '22 00:05 aaronhsueh0506

Yes, you need feed features(Ex[34], Exp[34], T, corr) extracted from frame length audio to neural network it's possible to run it in realtime frame by frame

jzi040941 avatar May 27 '22 04:05 jzi040941