wenet icon indicating copy to clipboard operation
wenet copied to clipboard

gpu decoding vs cpu decoding for libtorch

Open zyb8543d opened this issue 3 years ago • 2 comments

gpu decoding for libtorch is slow than cpu decoding on a same audio , whether the speed of my test on cpu and gpu is normal?

gpu decode:
real    1m5.747s
user    0m47.806s
sys     0m16.468s
cpu decode:
real    0m39.771s
user    0m37.880s
sys     0m1.975s

zyb8543d avatar Aug 09 '22 10:08 zyb8543d

what is the chunk size in your testing?

robin1001 avatar Aug 09 '22 12:08 robin1001

I use default chunk size, both for cpu and gpu decoding.

zyb8543d avatar Aug 10 '22 01:08 zyb8543d

I modify the chunk size as “-1、1、10” in params.h,but the decoding speed had no change. @robin1001

zyb8543d avatar Oct 26 '22 02:10 zyb8543d

Exactly the same problem. did you solve it?

hms1205 avatar Jan 03 '23 01:01 hms1205

Exactly the same problem. did you solve it?

no,move to another framework.

zyb8543d avatar Jan 03 '23 03:01 zyb8543d

Thanks for the reply!

hms1205 avatar Jan 03 '23 08:01 hms1205

please try to repeat 10 times

xingchensong avatar Feb 21 '23 04:02 xingchensong

This might be a warmup issue

xingchensong avatar Feb 21 '23 04:02 xingchensong

This issue has been automatically closed due to inactivity.

github-actions[bot] avatar Jan 16 '24 01:01 github-actions[bot]