faster-whisper icon indicating copy to clipboard operation
faster-whisper copied to clipboard

Published 20 hours ago • verified publisher icon SYSTRAN

Batch process available?

Open lionsheep24 opened this issue 1 year ago • 2 comments

Hello, I'm considering to implement this awesome project to my real-time stt system, which requires high throughput. But I'm not sure it supports batching, like huggingface. (in multi-gpu environment.) I found inter_threads but it seems to work at cpu env. Can faster-whisper transcribes multiple inputs?

lionsheep24 avatar May 20 '24 08:05 lionsheep24

@lionsheep24 , no. FW doesn't support multi batch.

trungkienbkhn avatar May 20 '24 11:05 trungkienbkhn

https://github.com/SYSTRAN/faster-whisper/pull/856

BBC-Esq avatar May 28 '24 01:05 BBC-Esq