Eren Akbiyik

Wow, this is great - thanks a lot @ggerganov! A quick follow-up question: would you recommend 2x speedup or reducing audio context size? Or can I mix them up, what...

interesting, but why is there less data, particularly if the `--length` parameter is set less than the context? What I assumed was that `--length` amount of data is used (if...

Perfect, thanks a lot, all of this makes full sense! Will try to do that -kc thing quite soon. Buuut I got one final follow-up just to understand it better:...

A-ha, lovely. Thanks a lot again!

Just to cross-reference: 4-bit quantization does not give the expected performance improvement in non-Apple ARM processors. In fact, there is a drastic reduction in performance: https://github.com/ggerganov/whisper.cpp/pull/540#issuecomment-1475167245

I can also reproduce this, without `stream.close()` the memory leaks. It seems to happen when I process the frames in a different process, and stream.close causes everything to hang if...

Hey @RoyaltyLJW, I still use `stream.close()`, and I was able to fix the deadlock issue by setting the environment variable `PYAV_LOGGING=off`. Here's that bug: https://github.com/PyAV-Org/PyAV/issues/751