RealtimeSTT icon indicating copy to clipboard operation
RealtimeSTT copied to clipboard

Published 20 hours ago • verified publisher icon KoljaB

how about the qulity of the batched faster-whisper？

Open jacobtang opened this issue 1 year ago • 1 comments

from faster_whisper import WhisperModel, BatchedInferencePipeline

model = WhisperModel("medium", device="cuda", compute_type="float16") batched_model = BatchedInferencePipeline(model=model)

Batched version improves the speed upto 10-12x compared to openAI implementation and 3-4x compared to the sequential faster_whisper version. It works by transcribing semantically meaningful audio chunks as batches leading to faster inference.

Will reatimeSTT support the batched version? Thanks!

jacobtang avatar Jul 26 '24 14:07 jacobtang