WhisperLive icon indicating copy to clipboard operation
WhisperLive copied to clipboard

GPU mode consumes half of available CPUs

Open zucher opened this issue 10 months ago • 1 comments

on the version 0.4.1, CPU transcription consume less cpu than GPU +CPU.

with: docker run -it -p 9090:9090 ghcr.io/collabora/whisperlive-cpu:latest

image

With GPU: docker run -it --gpus all -p 9090:9090 ghcr.io/collabora/whisperlive-gpu:latest

image

image

The called model was french / small So I don't understand why ? And with such results why still using GPU ;-)

so seriously seems threads not sleeping correctly during GPU processing.

zucher avatar Apr 08 '24 12:04 zucher

I have the same issue

Asma-droid avatar Apr 09 '24 06:04 Asma-droid