whisper.cpp icon indicating copy to clipboard operation
whisper.cpp copied to clipboard

Attempt to improve threading in ggml

Open ggerganov opened this issue 1 year ago • 0 comments

ref #200

Instead of creating and joining new threads for each graph compute, we create a thread pool with active threads and make them wait on a condition variable instead of joining.

Surprisingly, this does not seem to improve the performance. It is actually degraded. Not sure what is going on.

ggerganov avatar Dec 29 '22 11:12 ggerganov