RndyP

I'm seeing the same issue. For instance, I send 10 seconds of audio that has simply the number "six" repeated six times, and Whisper gets to work on it and...

What is your platform?

I used the Visual Studio performance profiler to see where all the CPU time is spent. Half the time is in the SIMD code here:  I reviewed the code...

Thanks for the explanation. I set the temp to -1.0 as you suggested. And yes, I get more tokens, but it seems I get no responses that take upward of...

Just discovered an easy way to work around this. If in command mode, where you are sending short chunks and expecting just a couple words and numbers, say 3 seconds...

Yes. See Discussion #211

Over in discussion #211 I described how I am doing realtime transcription. It works well. I should add that if I encounter more than 10 seconds without a gap, I...

Maybe @ggerganov can chime in here, but it seems to me that what you are asking may be difficult. Whisper seems to have a fixed processing offset, by that I...

I viewed your video, and see what you mean. It responds very quickly. Again, I'm not sure whisper is going to deliver that smoothly because of what I'm calling the...

I've written a C++/MFC app that uses Whisper. It is performing real time transcription using the tiny model. I don't see any memory leaking, either by observing Resource Monitor, Task...