RTF for cpu

[lalimili6]

Hi dear, can report RTF for cpu? best regards

[csukuangfj]

https://github.com/k2-fsa/sherpa#rtf-test

Can you use the above colab notebook to measure RTF for CPU. (The default is using GPU).

A PR is welcome if you can do that.

Thanks

[ezerhouni]

@csukuangfj Actually I was about to create an issue to tackle it (to also have an RTF for streaming model, etc) :)

[csukuangfj]

@csukuangfj Actually I was about to create an issue to tackle it (to also have an RTF for streaming model, etc) :)

That would be very nice of you. If @lalimili6 does not respond, I suggest that you can just start it.

[ezerhouni]

@csukuangfj Actually I was about to create an issue to tackle it (to also have an RTF for streaming model, etc) :)

That would be very nice of you. If @lalimili6 does not respond, I suggest that you can just start it.

I will work first on the refactoring of the beam search, if time allows I will give a look to RTF

[csukuangfj]

Thanks!

[ezerhouni]

@csukuangfj Also, I was thinking to maybe add the RTF in Results.md in icefall, to give a sense of how much CPU/GPU usage it needs (so not only comparing WER but also RTF), wdyt ?

[csukuangfj]

@csukuangfj Also, I was thinking to maybe add the RTF in Results.md in icefall, to give a sense of how much CPU/GPU usage it needs (so not only comparing WER but also RTF), wdyt ?

Yes, that is a good idea. I also suggest adding the number of parameters of the model to RESULTS.md.

Since RTF depends on what hardware you are using, shall we also list the environment in which RTF is measured?

[ezerhouni]

I also suggest adding the number of parameters of the model to RESULTS.md.

Agree !

Since RTF depends on what hardware you are using, shall we also list the environment in which RTF is measured?

Yes, testing for both CPU and GPU, with description of hardware + software (cuda, cudnn, etc).

[ezerhouni]

@csukuangfj I tried to add the RTF for the streaming pipeline. However, I keep having sent 1011 (unexpected error) keepalive ping timeout; no close frame received any idea why ? (I can create a PR for you to have a look into the code if you want)

[csukuangfj]

@csukuangfj I tried to add the RTF for the streaming pipeline. However, I keep having sent 1011 (unexpected error) keepalive ping timeout; no close frame received any idea why ? (I can create a PR for you to have a look into the code if you want)

Thanks for testing it.

I think it is the same error reported in https://github.com/k2-fsa/sherpa/issues/84

I will look into it during the weekend.

[lalimili6]

Here are results https://github.com/k2-fsa/sherpa/pull/168 many thanks