faster-whisper icon indicating copy to clipboard operation
faster-whisper copied to clipboard

slower inference with 1.0.0 compared to 0.10.0

Open thomasmol opened this issue 1 year ago • 2 comments

I am getting about 4x slower inference with version 1.0.0 compared to 0.10.0.

I used a 1 min 17 sec sample file, run on an A10G GPU

Before: Finished transcribing, took 5.043 seconds. Detected language: en

Now: Finished transcribing, took 21.936 seconds. Detected language: en

I did not change my config other than upgrading to 1.0.0

Only seems to happen on very short files, tested a 25 min file that transcribed at the same speed as before.

Any ideas?

thomasmol avatar Feb 22 '24 10:02 thomasmol

@thomasmol , hello. Can you check this PR and rerun your tests ?

trungkienbkhn avatar Feb 23 '24 12:02 trungkienbkhn

That fixes it! Finished transcribing, took 5.1937 seconds. Detected language: en back to normal

thomasmol avatar Feb 23 '24 14:02 thomasmol