faster_whisper batch operation time-consuming

[dyyzhmm]

Is this related to CTranslate?

The following is copied from this . I have made a test, for batching in faster-whisper.

But faster_whisper batch encode consume multiple time as sample's amount, it seems encode in batch not work as expected by CTranslate?

By the way, the decode/generate have the same issue when in-Batch ops.